Sep 06 12:16:00.082821 ip-10-0-134-80 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 06 12:16:00.082834 ip-10-0-134-80 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 06 12:16:00.082843 ip-10-0-134-80 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 06 12:16:00.083186 ip-10-0-134-80 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 06 12:16:10.142488 ip-10-0-134-80 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 06 12:16:10.142503 ip-10-0-134-80 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6586dbdee4a44712a7e192891109bed9 --
Sep 06 12:17:39.899908 ip-10-0-134-80 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 12:17:40.349010 ip-10-0-134-80 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 12:17:40.349010 ip-10-0-134-80 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 12:17:40.349010 ip-10-0-134-80 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 12:17:40.349010 ip-10-0-134-80 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 12:17:40.349010 ip-10-0-134-80 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 12:17:40.351455 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.351381    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 12:17:40.355402 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355388    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:40.355402 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355402    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355406    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355410    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355414    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355418    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355430    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355434    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355438    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355440    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355443    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355446    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355448    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355451    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355453    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355465    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355468    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355471    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355474    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:40.355470 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355477    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355480    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355482    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355485    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355488    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355491    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355493    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355496    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355498    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355501    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355503    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355507    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355509    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355512    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355515    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355517    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355520    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355522    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355525    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355527    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:40.355952 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355530    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355532    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355535    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355537    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355540    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355543    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355545    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355548    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355550    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355552    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355555    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355557    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355562    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355567    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355570    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355573    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355576    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355579    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355581    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355584    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:40.356551 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355587    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355589    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355592    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355606    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355609    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355612    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355615    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355617    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355620    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355622    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355625    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355628    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355631    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355634    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355636    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355639    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355641    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355643    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355646    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:40.357068 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355648    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355651    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355653    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355656    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355658    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355660    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355664    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355667    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355670    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355673    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355676    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355680    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355683    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355686    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355689    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355691    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355694    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355696    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355699    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:40.357534 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355701    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.355704    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356400    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356407    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356410    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356413    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356416    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356420    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356423    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356427    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356429    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356432    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356435    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356437    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356440    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356442    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356445    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356448    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356451    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356453    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:40.358018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356456    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356458    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356461    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356463    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356465    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356468    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356471    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356473    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356476    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356478    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356481    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356483    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356486    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356488    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356491    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356493    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356496    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356498    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356501    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:40.358506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356503    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356508    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356511    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356514    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356517    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356520    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356523    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356525    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356528    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356531    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356534    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356536    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356539    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356541    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356544    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356546    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356548    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356551    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356553    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:40.359014 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356556    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356559    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356561    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356564    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356567    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356569    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356571    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356574    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356576    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356579    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356582    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356585    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356587    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356589    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356592    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356614    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356618    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356620    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356623    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356626    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:40.359489 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356628    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356631    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356633    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356636    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356640    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356642    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356645    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356647    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356650    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356652    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356656    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356659    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356662    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356665    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356668    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356671    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356673    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356675    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356678    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:40.360001 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356681    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356684    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356687    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.356690    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357031    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357036    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357039    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357041    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357046    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357052    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357055    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357058    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357060    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357063    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357065    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357068    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357071    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357074    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357076    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:40.360455 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357079    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357082    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357084    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357087    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357089    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357092    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357094    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357097    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357099    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357102    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357104    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357106    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357109    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357113    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357115    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357118    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357120    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357122    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357125    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357127    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:40.360936 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357132    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357135    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357139    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357142    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357144    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357146    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357149    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357152    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357154    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357156    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357159    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357161    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357164    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357167    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357170    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357173    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357175    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357178    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357180    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357183    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:40.361408 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357185    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357188    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357191    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357194    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357197    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357200    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357203    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357206    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357209    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357212    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357215    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357218    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357222    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357224    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357228    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357231    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357234    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357236    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357238    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:40.361912 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357241    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357243    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357246    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357248    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357251    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357253    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357256    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357258    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357261    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357263    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357265    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357268    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357271    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357273    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357275    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357278    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357280    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357283    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357285    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357288    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:40.362393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357290    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357292    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357295    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357297    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357300    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357378    2568 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357409    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357416    2568 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357420    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357427    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357430    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357435    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357438    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357441    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357444    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357447    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357450    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357453    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357456    2568 flags.go:64] FLAG: --cgroup-root=""
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357459    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357462    2568 flags.go:64] FLAG: --client-ca-file=""
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357464    2568 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357467    2568 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357471    2568 flags.go:64] FLAG: --cluster-domain=""
Sep 06 12:17:40.362940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357474    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357477    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357480    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357483    2568 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357487    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357489    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357492    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357495    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357498    2568 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357501    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357504    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357507    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357509    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357514    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357517    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357522    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357524    2568 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357527    2568 flags.go:64] FLAG: --enable-server="true"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357530    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357534    2568 flags.go:64] FLAG: --event-burst="100"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357537    2568 flags.go:64] FLAG: --event-qps="50"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357540    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357543    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357546    2568 flags.go:64] FLAG: --eviction-hard=""
Sep 06 12:17:40.363524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357549    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357552    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357555    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357557    2568 flags.go:64] FLAG: --eviction-soft=""
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357560    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357563    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357565    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357568    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357571    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357573    2568 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357576    2568 flags.go:64] FLAG: --feature-gates=""
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357579    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357582    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357585    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357588    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357591    2568 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357608    2568 flags.go:64] FLAG: --help="false"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357611    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357614    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357617    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357619    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357624    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357627    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357635    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 12:17:40.364108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357638    2568 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357641    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357644    2568 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357647    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357650    2568 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357653    2568 flags.go:64] FLAG: --kube-reserved=""
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357655    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357658    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357661    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357664    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357666    2568 flags.go:64] FLAG: --lock-file=""
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357669    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357672    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357674    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357679    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357682    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357685    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357687    2568 flags.go:64] FLAG: --logging-format="text"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357690    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357693    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357696    2568 flags.go:64] FLAG: --manifest-url=""
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357699    2568 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357703    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357706    2568 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357710    2568 flags.go:64] FLAG: --max-pods="110"
Sep 06 12:17:40.364730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357712    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357715    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357718    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357721    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357725    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357728    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357732    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357739    2568 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357741    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357744    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357747    2568 flags.go:64] FLAG: --pod-cidr=""
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357750    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357755    2568 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357758    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357761    2568 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357764    2568 flags.go:64] FLAG: --port="10250"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357767    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357770    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b1590c6cb4d79ab"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357773    2568 flags.go:64] FLAG: --qos-reserved=""
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357776    2568 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357779    2568 flags.go:64] FLAG: --register-node="true"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357782    2568 flags.go:64] FLAG: --register-with-taints=""
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357785    2568 flags.go:64] FLAG: --registry-burst="10"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357788    2568 flags.go:64] FLAG: --registry-qps="5"
Sep 06 12:17:40.365369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357790    2568 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357793    2568 flags.go:64] FLAG: --reserved-memory=""
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357796    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357799    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357802    2568 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357804    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357807    2568 flags.go:64] FLAG: --runonce="false"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357810    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357813    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357816    2568 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357818    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357821    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357824    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357828    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357831    2568 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357834    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357837    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357840    2568 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357843    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357846    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357849    2568 flags.go:64] FLAG: --system-cgroups=""
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357852    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357857    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357859    2568 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357862    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 12:17:40.365980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357866    2568 flags.go:64] FLAG: --tls-min-version=""
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357868    2568 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357871    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357873    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357876    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357879    2568 flags.go:64] FLAG: --v="2"
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357883    2568 flags.go:64] FLAG: --version="false"
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357886    2568 flags.go:64] FLAG: --vmodule=""
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357889    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.357892    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357994    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.357998    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358001    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358004    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358007    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358010    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358012    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358016    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358019    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358021    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358026    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358030    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:40.366611 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358033    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358036    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358039    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358041    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358044    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358046    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358049    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358052    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358054    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358056    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358059    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358061    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358064    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358066    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358069    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358071    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358075    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358078    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358081    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:40.367146 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358084    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358087    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358089    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358092    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358094    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358097    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358099    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358102    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358105    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358107    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358111    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358115    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358117    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358120    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358123    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358125    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358128    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358130    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358133    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:40.367619 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358135    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358138    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358141    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358143    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358145    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358148    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358150    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358152    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358155    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358157    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358160    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358162    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358165    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358167    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358169    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358172    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358174    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358177    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358179    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:40.368113 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358183    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358187    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358190    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358193    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358195    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358197    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358200    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358202    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358205    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358207    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358210    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358212    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358215    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358217    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358220    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358223    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358225    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358228    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358231    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358233    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:40.368579 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358236    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358238    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358241    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358243    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358245    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358248    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358250    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358252    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358255    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.358258    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.359001    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.366237    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.366251    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.367187    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 12:17:40.369121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.367194    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367247    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367253    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367257    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367261    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367265    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367268    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367271    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367273    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367276    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367279    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367281    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367284    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367287    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367290    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367292    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367295    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367298    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367300    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:40.369459 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367303    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367305    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367307    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367310    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367312    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367315    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367317    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367320    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367322    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367325    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367328    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367331    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367334    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367336    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367339    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367341    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367344    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367346    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367349    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367351    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:40.369925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367354    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367356    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367359    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367361    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367364    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367366    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367368    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367371    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367374    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367376    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367379    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367381    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367383    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367386    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367389    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367391    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367394    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367396    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367398    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:40.370406 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367401    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367403    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367406    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367408    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367411    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367414    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367416    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367419    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367429    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367432    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367435    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367437    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367440    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367442    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367445    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367448    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367450    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367453    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367456    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367458    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:40.370860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367461    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367464    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367467    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367469    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367472    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367474    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367477    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367479    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367482    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367484    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367487    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367491    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367494    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367497    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367500    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367502    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367505    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367508    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367510    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367513    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:40.371332 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367515    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367517    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.367522    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367647    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367653    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367656    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367659    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367661    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367664    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367666    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367668    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367671    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367673    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367676    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:40.371860 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367678    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367681    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367684    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367686    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367688    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367691    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367693    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367696    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367698    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367701    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367703    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367706    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367708    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367710    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367713    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367715    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367718    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367720    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367723    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367725    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:40.372247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367728    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367730    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367733    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367735    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367738    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367740    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367742    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367745    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367747    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367750    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367752    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367754    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367757    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367760    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367762    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367764    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367767    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367769    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367772    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367775    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:40.372749 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367778    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367780    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367782    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367786    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367789    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367792    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367796    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367799    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367802    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367804    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367807    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367810    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367812    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367815    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367817    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367819    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367822    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367824    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367827    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367829    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:40.373344 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367832    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367834    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367837    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367839    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367841    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367844    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367846    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367849    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367851    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367854    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367856    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367859    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367861    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367864    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367867    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367870    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367873    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367876    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367879    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:40.373873 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367881    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367884    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367887    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367889    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367891    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367894    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367896    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367899    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:40.367901    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.367906    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.368864    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.371843    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.372887    2568 server.go:1019] "Starting client certificate rotation"
Sep 06 12:17:40.374324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.372992    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 12:17:40.374645 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.373024    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 12:17:40.375710 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.375696    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 12:17:40.378058 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.378034    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 12:17:40.390673 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.390655    2568 log.go:25] "Validated CRI v1 runtime API"
Sep 06 12:17:40.394076 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.394061    2568 log.go:25] "Validated CRI v1 image API"
Sep 06 12:17:40.394857 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.394841    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 12:17:40.398228 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.398203    2568 fs.go:135] Filesystem UUIDs: map[30929264-d575-4f65-b1c3-9d986e990e83:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d8d4d4c5-47e7-41db-9c9f-6de4a5be0907:/dev/nvme0n1p4]
Sep 06 12:17:40.398300 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.398227    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 12:17:40.404028 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.403918    2568 manager.go:216] Machine: {Timestamp:2026-09-06 12:17:40.402671855 +0000 UTC m=+0.376719031 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102808 MemoryCapacity:32812142592 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23b2c4bb4a96bd4df41add15f68c16 SystemUUID:ec23b2c4-bb4a-96bd-4df4-1add15f68c16 BootID:6586dbde-e4a4-4712-a7e1-92891109bed9 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406073344 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406069248 Type:vfs Inodes:4005388 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:56:a3:98:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:56:a3:98:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:93:14:6f:89:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812142592 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 12:17:40.404028 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.404017    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 12:17:40.404174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.404102    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 12:17:40.405227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.405209    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 12:17:40.405227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.405208    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 12:17:40.405375 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.405237    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 12:17:40.406114 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.406103    2568 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 12:17:40.406154 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.406116    2568 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 12:17:40.406154 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.406123    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 12:17:40.407878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.407865    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 12:17:40.409816 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.409805    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 12:17:40.415082 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415071    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 12:17:40.415193 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415184    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 12:17:40.415223 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415212    2568 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 12:17:40.415223 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415222    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 12:17:40.415278 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415235    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 12:17:40.415278 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415244    2568 kubelet.go:398] "Adding apiserver pod source"
Sep 06 12:17:40.415278 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415253    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 12:17:40.415552 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415538    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 12:17:40.415610 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.415563    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 12:17:40.419107 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.419090    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 12:17:40.421926 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.421913    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 12:17:40.421977 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.421943    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 12:17:40.422776 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422764    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 12:17:40.422811 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422786    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 12:17:40.422811 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422793    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 12:17:40.422811 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422799    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 12:17:40.422811 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422807    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 12:17:40.422907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422814    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 12:17:40.422907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422829    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 12:17:40.422907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422834    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 12:17:40.422907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422841    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 12:17:40.422907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422846    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 12:17:40.422907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422853    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 12:17:40.422907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.422861    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 12:17:40.423727 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.423707    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 12:17:40.423768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.423729    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 12:17:40.425491 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.425465    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 12:17:40.425539 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.425487    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 12:17:40.426232 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.426218    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xvdsl"
Sep 06 12:17:40.427731 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.427718    2568 server.go:1268] "Started kubelet"
Sep 06 12:17:40.427838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.427812    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 12:17:40.427838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.427802    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 12:17:40.427940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.427863    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 12:17:40.428420 ip-10-0-134-80 systemd[1]: Started Kubernetes Kubelet.
Sep 06 12:17:40.429137 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.428983    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 12:17:40.433706 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.433683    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 12:17:40.434644 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.434621    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 12:17:40.435140 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.435125    2568 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 12:17:40.435843 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.435826    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xvdsl"
Sep 06 12:17:40.437807 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.436687    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-80.ec2.internal.18d2ba7fe193f486  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-80.ec2.internal,UID:ip-10-0-134-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-80.ec2.internal,},FirstTimestamp:2026-09-06 12:17:40.427691142 +0000 UTC m=+0.401738317,LastTimestamp:2026-09-06 12:17:40.427691142 +0000 UTC m=+0.401738317,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-80.ec2.internal,}"
Sep 06 12:17:40.439397 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.439382    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 12:17:40.440077 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.440062    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 12:17:40.440317 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.440294    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:40.440903 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.440887    2568 factory.go:55] Registering systemd factory
Sep 06 12:17:40.440903 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.440902    2568 factory.go:223] Registration of the systemd container factory successfully
Sep 06 12:17:40.441045 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.440954    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 12:17:40.441045 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.440955    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 12:17:40.441045 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.440972    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 12:17:40.441045 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.441042    2568 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 12:17:40.441045 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.441049    2568 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 12:17:40.441207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.441146    2568 factory.go:153] Registering CRI-O factory
Sep 06 12:17:40.441207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.441157    2568 factory.go:223] Registration of the crio container factory successfully
Sep 06 12:17:40.441207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.441195    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 12:17:40.441207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.441207    2568 factory.go:103] Registering Raw factory
Sep 06 12:17:40.441351 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.441217    2568 manager.go:1196] Started watching for new ooms in manager
Sep 06 12:17:40.441504 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.441493    2568 manager.go:349] Starting recovery of all containers
Sep 06 12:17:40.447548 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.447525    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:40.451399 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.451381    2568 manager.go:354] Recovery completed
Sep 06 12:17:40.452542 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.452525    2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 06 12:17:40.454627 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.454589    2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.455644 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.455633    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:40.457105 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.457090    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:40.457151 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.457116    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:40.457151 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.457126    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:40.457649 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.457630    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 12:17:40.457649 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.457647    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 12:17:40.457809 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.457667    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 12:17:40.457809 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.457651    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:40.458388 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.458375    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:40.458448 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.458397    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:40.458448 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.458406    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:40.459705 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.459692    2568 policy_none.go:49] "None policy: Start"
Sep 06 12:17:40.459771 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.459708    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 12:17:40.459771 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.459717    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 12:17:40.461646 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.461636    2568 policy_none.go:47] "Start"
Sep 06 12:17:40.483626 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.483592    2568 manager.go:337] "Starting Device Plugin manager"
Sep 06 12:17:40.483720 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.483663    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 12:17:40.483720 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.483676    2568 server.go:87] "Starting device plugin registration server"
Sep 06 12:17:40.483951 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.483938    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 12:17:40.484015 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.483949    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 12:17:40.484072 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.484053    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 12:17:40.484142 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.484124    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 12:17:40.484189 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.484143    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 12:17:40.484544 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.484524    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 12:17:40.484661 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.484571    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:40.507237 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.507213    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 12:17:40.520106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.508464    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 12:17:40.520106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.508503    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 12:17:40.520106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.508519    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 12:17:40.520106 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.508556    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 12:17:40.520106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.510741    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:40.584241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.584220    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:40.584955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.584940    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:40.585020 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.584968    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:40.585020 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.584983    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:40.585020 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.585006    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.591742 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.591728    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.591803 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.591746    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-80.ec2.internal\": node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:40.606172 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.606109    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:40.608986 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.608971    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"]
Sep 06 12:17:40.609047 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.609038    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:40.610883 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.610868    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:40.610970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.610896    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:40.610970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.610910    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:40.613203 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613189    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:40.613330 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613316    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.613375 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613346    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:40.613887 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613873    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:40.613887 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613883    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:40.614025 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613898    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:40.614025 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613905    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:40.614025 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613911    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:40.614025 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.613918    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:40.616176 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.616161    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.616221 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.616185    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:40.617108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.617092    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:40.617196 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.617122    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:40.617196 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.617135    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:40.642075 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.642054    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.646070 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.646056    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.706557 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.706544    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:40.743041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.743024    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/455915a86d33fb89c073fa9c973de3d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"455915a86d33fb89c073fa9c973de3d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.743103 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.743091    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/455915a86d33fb89c073fa9c973de3d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"455915a86d33fb89c073fa9c973de3d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.743139 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.743114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6303ebc88473edaa1e2fd9f6ceeefbf-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"d6303ebc88473edaa1e2fd9f6ceeefbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.807024 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.807006    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:40.843328 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.843309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6303ebc88473edaa1e2fd9f6ceeefbf-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"d6303ebc88473edaa1e2fd9f6ceeefbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.843384 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.843372    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/455915a86d33fb89c073fa9c973de3d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"455915a86d33fb89c073fa9c973de3d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.843418 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.843337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/455915a86d33fb89c073fa9c973de3d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"455915a86d33fb89c073fa9c973de3d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.843418 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.843403    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6303ebc88473edaa1e2fd9f6ceeefbf-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"d6303ebc88473edaa1e2fd9f6ceeefbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.843491 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.843422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/455915a86d33fb89c073fa9c973de3d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"455915a86d33fb89c073fa9c973de3d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.843491 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.843444    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/455915a86d33fb89c073fa9c973de3d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"455915a86d33fb89c073fa9c973de3d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.907616 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:40.907567    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:40.946236 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.946219    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:40.949878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:40.949863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:41.008130 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:41.008106    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:41.108561 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:41.108538    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:41.209104 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:41.209059    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:41.253527 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.253508    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:41.309660 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:41.309641    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:41.372135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.372103    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 12:17:41.372491 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.372222    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 12:17:41.372491 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.372253    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 12:17:41.372491 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.372278    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 12:17:41.410408 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:41.410380    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:41.440922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.440896    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 12:12:40 +0000 UTC" deadline="2028-03-17 10:00:40.458804086 +0000 UTC"
Sep 06 12:17:41.440922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.440922    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13389h42m59.017885911s"
Sep 06 12:17:41.511440 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:41.511389    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:41.537904 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:41.537882    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455915a86d33fb89c073fa9c973de3d3.slice/crio-2f26d39b7251b1c379fac751812a3472145262f5fcc837ae2110c8e9391d09d7 WatchSource:0}: Error finding container 2f26d39b7251b1c379fac751812a3472145262f5fcc837ae2110c8e9391d09d7: Status 404 returned error can't find the container with id 2f26d39b7251b1c379fac751812a3472145262f5fcc837ae2110c8e9391d09d7
Sep 06 12:17:41.548130 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.548118    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:17:41.556908 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:41.556889    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6303ebc88473edaa1e2fd9f6ceeefbf.slice/crio-cab25bafa5c7a4f031ea7444194e087c9ae75e4ff921991dddcd3eca47c153c3 WatchSource:0}: Error finding container cab25bafa5c7a4f031ea7444194e087c9ae75e4ff921991dddcd3eca47c153c3: Status 404 returned error can't find the container with id cab25bafa5c7a4f031ea7444194e087c9ae75e4ff921991dddcd3eca47c153c3
Sep 06 12:17:41.611736 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:41.611715    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:41.711811 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:41.711792    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
Sep 06 12:17:41.712701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.712685    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:41.741148 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.741131    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:41.752492 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.752477    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 12:17:41.753729 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.753717    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
Sep 06 12:17:41.765386 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:41.765351    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 12:17:42.415856 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.415827    2568 apiserver.go:52] "Watching apiserver"
Sep 06 12:17:42.425393 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.425240    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:42.427465 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.427447    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 12:17:42.427879 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.427857    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-dzk4s","openshift-network-operator/iptables-alerter-5w9k5","openshift-ovn-kubernetes/ovnkube-node-ntbvk","kube-system/global-pull-secret-syncer-g6tjq","kube-system/konnectivity-agent-4mmjh","kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal","openshift-multus/multus-additional-cni-plugins-rcvxx","openshift-network-diagnostics/network-check-target-wfbzs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz","openshift-cluster-node-tuning-operator/tuned-wj6qs","openshift-dns/node-resolver-59v9r","openshift-image-registry/node-ca-lfrbv","openshift-multus/multus-54lh8"]
Sep 06 12:17:42.430781 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.430389    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.433071 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.432340    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 12:17:42.433071 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.432482    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 12:17:42.433071 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.432534    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 12:17:42.433071 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.432704    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.433071 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.432714    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zmqzk\""
Sep 06 12:17:42.434642 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.434432    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 12:17:42.434845 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.434829    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.435683 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.435667    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 12:17:42.435863 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.435845    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n4sc5\""
Sep 06 12:17:42.435933 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.435901    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 12:17:42.437199 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.437182    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 12:17:42.437283 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.437256    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.437342 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.437308    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:42.437825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.437806    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 12:17:42.437908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.437813    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hb8r8\""
Sep 06 12:17:42.437996 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.437981    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 12:17:42.438049 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.438031    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 12:17:42.438124 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.438111    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 12:17:42.438178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.438167    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 12:17:42.439897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.439880    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 12:17:42.442705 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.442660    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:17:42.444840 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.444755    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 12:17:42.444967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.444887    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 12:17:42.444967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.444934    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rt5dn\""
Sep 06 12:17:42.445123 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.445110    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.447091 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.446981    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 12:17:42.447091 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.447057    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 12:17:42.447242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.447213    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 12:17:42.447242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.447243    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xdm6x\""
Sep 06 12:17:42.447535 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.447509    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 12:17:42.448182 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.448166    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:42.448260 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.448229    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:42.450245 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.450227    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 12:17:42.450536 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.450522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.451121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-systemd-units\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vkhh\" (UniqueName: \"kubernetes.io/projected/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-kube-api-access-4vkhh\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451140    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22d4a411-4b50-431e-9719-f9c92e0064b2-konnectivity-ca\") pod \"konnectivity-agent-4mmjh\" (UID: \"22d4a411-4b50-431e-9719-f9c92e0064b2\") " pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:17:42.451200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-sys-fs\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.451200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451165    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-run-netns\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-etc-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451189    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovn-node-metrics-cert\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451202    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22d4a411-4b50-431e-9719-f9c92e0064b2-agent-certs\") pod \"konnectivity-agent-4mmjh\" (UID: \"22d4a411-4b50-431e-9719-f9c92e0064b2\") " pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13171d83-fc1e-4f9b-b75a-edadb8cff3da-serviceca\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-node-log\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451239    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-env-overrides\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451251    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovnkube-script-lib\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451272    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bfe89a28-bbb4-475f-8219-d93d063bc226-kubelet-config\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451286    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bfe89a28-bbb4-475f-8219-d93d063bc226-dbus\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451310    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-log-socket\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-cni-bin\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451351    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovnkube-config\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-registration-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-slash\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451399    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-var-lib-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-ovn\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.451503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-cni-netd\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451452    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-socket-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451609    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-device-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451636    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxtv\" (UniqueName: \"kubernetes.io/projected/407ae861-c297-4742-a20b-89a7b99fdf8d-kube-api-access-xvxtv\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451681    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13171d83-fc1e-4f9b-b75a-edadb8cff3da-host\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-systemd\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brmnz\" (UniqueName: \"kubernetes.io/projected/13171d83-fc1e-4f9b-b75a-edadb8cff3da-kube-api-access-brmnz\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.452084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.451809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-kubelet\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.452612 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.452457    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 12:17:42.452612 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.452469    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 12:17:42.455890 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.455868    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-twztj\""
Sep 06 12:17:42.456799 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.456781    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.458656 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.458624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:42.458742 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.458712    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:42.458997 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.458975    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 12:17:42.459121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.459103    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m46lq\""
Sep 06 12:17:42.459210 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.459192    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 12:17:42.459412 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.459399    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:17:42.461122 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.461105    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.464385 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.463208    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.464385 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.463648    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2gx9q\""
Sep 06 12:17:42.464385 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.463719    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:17:42.464385 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.463858    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 12:17:42.465234 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.465217    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 12:17:42.465753 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.465737    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 12:17:42.465831 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.465800    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r6nr6\""
Sep 06 12:17:42.469747 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.469731    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f9ftm"
Sep 06 12:17:42.476922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.476905    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f9ftm"
Sep 06 12:17:42.512922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.512889    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" event={"ID":"d6303ebc88473edaa1e2fd9f6ceeefbf","Type":"ContainerStarted","Data":"cab25bafa5c7a4f031ea7444194e087c9ae75e4ff921991dddcd3eca47c153c3"}
Sep 06 12:17:42.513981 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.513962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"455915a86d33fb89c073fa9c973de3d3","Type":"ContainerStarted","Data":"2f26d39b7251b1c379fac751812a3472145262f5fcc837ae2110c8e9391d09d7"}
Sep 06 12:17:42.542169 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.542029    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 12:17:42.552508 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552476    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-systemd-units\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.552635 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552572    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22d4a411-4b50-431e-9719-f9c92e0064b2-konnectivity-ca\") pod \"konnectivity-agent-4mmjh\" (UID: \"22d4a411-4b50-431e-9719-f9c92e0064b2\") " pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:17:42.552635 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-multus-certs\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.552741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-lib-modules\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.552790 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552751    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-systemd-units\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.552833 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552781    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-run-netns\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.552878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-etc-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.552922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552883    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22d4a411-4b50-431e-9719-f9c92e0064b2-agent-certs\") pod \"konnectivity-agent-4mmjh\" (UID: \"22d4a411-4b50-431e-9719-f9c92e0064b2\") " pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:17:42.552999 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.552976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-etc-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553049 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553031    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-cni-bin\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.553093 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-kubelet\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.553093 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553083    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysctl-d\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.553179 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553107    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-run\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.553179 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553134    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-hostroot\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.553179 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-node-log\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553291 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-env-overrides\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553291 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-tmp-dir\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.553291 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553291 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553277    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-log-socket\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553298    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-cni-bin\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553323    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovnkube-config\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553346    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-cnibin\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.553456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22d4a411-4b50-431e-9719-f9c92e0064b2-konnectivity-ca\") pod \"konnectivity-agent-4mmjh\" (UID: \"22d4a411-4b50-431e-9719-f9c92e0064b2\") " pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:17:42.553456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553370    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-host\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.553456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.553456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-registration-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.553456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553452    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcqpm\" (UniqueName: \"kubernetes.io/projected/7c8f16ac-746a-474f-ae8a-76c16a64aec1-kube-api-access-kcqpm\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.553884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553612    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-run-netns\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-log-socket\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-cni-bin\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.553884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.553853    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-env-overrides\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.554166 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554148    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovnkube-config\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.554246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-registration-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.554398 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-node-log\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.554451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554420    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-cnibin\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.554451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554435    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 12:17:42.554451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-cni-netd\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.554611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554472    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-conf-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.554611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.554611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.554611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-systemd\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.554611 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554582    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-socket-dir-parent\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.554821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-netns\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.554821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554711    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-cni-netd\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.554821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554763    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.554821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554765    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysctl-conf\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.554821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554802    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-iptables-alerter-script\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.554821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554803    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554838    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-systemd\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554874    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-kubelet\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554899    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmnmr\" (UniqueName: \"kubernetes.io/projected/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-kube-api-access-dmnmr\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-kubelet\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vkhh\" (UniqueName: \"kubernetes.io/projected/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-kube-api-access-4vkhh\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.554979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-kubernetes\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555006    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chvkp\" (UniqueName: \"kubernetes.io/projected/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-kube-api-access-chvkp\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-sys-fs\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.555062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovn-node-metrics-cert\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555085    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-k8s-cni-cncf-io\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555113    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drlpt\" (UniqueName: \"kubernetes.io/projected/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-kube-api-access-drlpt\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-etc-kubernetes\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555154    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13171d83-fc1e-4f9b-b75a-edadb8cff3da-serviceca\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovnkube-script-lib\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bfe89a28-bbb4-475f-8219-d93d063bc226-kubelet-config\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bfe89a28-bbb4-475f-8219-d93d063bc226-dbus\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-system-cni-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c8f16ac-746a-474f-ae8a-76c16a64aec1-cni-binary-copy\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-systemd\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555322    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-cni-multus\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-sys\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555369    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555390    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-slash\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.555476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555415    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-modprobe-d\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.556132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555581    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-slash\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.556132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555665    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bfe89a28-bbb4-475f-8219-d93d063bc226-kubelet-config\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.556132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555825    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bfe89a28-bbb4-475f-8219-d93d063bc226-dbus\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.556132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555876    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-tmp\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.556132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzxdj\" (UniqueName: \"kubernetes.io/projected/2564df60-c9eb-4e85-82df-d44f54880bbb-kube-api-access-bzxdj\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.556132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:42.556132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.555992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-var-lib-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.556132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556041    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-ovn\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556100    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovnkube-script-lib\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556267    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-sys-fs\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-daemon-config\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556044    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-var-lib-openvswitch\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556309    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13171d83-fc1e-4f9b-b75a-edadb8cff3da-serviceca\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556327    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556370    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-run-ovn\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556370    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556430    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-socket-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.556502 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.556464    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-device-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556558    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxtv\" (UniqueName: \"kubernetes.io/projected/407ae861-c297-4742-a20b-89a7b99fdf8d-kube-api-access-xvxtv\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556583    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-device-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13171d83-fc1e-4f9b-b75a-edadb8cff3da-host\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556633    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/407ae861-c297-4742-a20b-89a7b99fdf8d-socket-dir\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-cni-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556659    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysconfig\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13171d83-fc1e-4f9b-b75a-edadb8cff3da-host\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.556743    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret podName:bfe89a28-bbb4-475f-8219-d93d063bc226 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:43.056707305 +0000 UTC m=+3.030754469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret") pod "global-pull-secret-syncer-g6tjq" (UID: "bfe89a28-bbb4-475f-8219-d93d063bc226") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556767    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-var-lib-kubelet\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-tuned\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brmnz\" (UniqueName: \"kubernetes.io/projected/13171d83-fc1e-4f9b-b75a-edadb8cff3da-kube-api-access-brmnz\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556879    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-hosts-file\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.557006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.556976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjx8\" (UniqueName: \"kubernetes.io/projected/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-kube-api-access-6vjx8\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.557509 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.557014    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:42.557509 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.557077    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-system-cni-dir\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.557509 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.557145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-host-slash\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.558452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.558434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-ovn-node-metrics-cert\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.558533 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.558508    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22d4a411-4b50-431e-9719-f9c92e0064b2-agent-certs\") pod \"konnectivity-agent-4mmjh\" (UID: \"22d4a411-4b50-431e-9719-f9c92e0064b2\") " pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:17:42.564171 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.564125    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxtv\" (UniqueName: \"kubernetes.io/projected/407ae861-c297-4742-a20b-89a7b99fdf8d-kube-api-access-xvxtv\") pod \"aws-ebs-csi-driver-node-hskdz\" (UID: \"407ae861-c297-4742-a20b-89a7b99fdf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.564345 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.564324    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vkhh\" (UniqueName: \"kubernetes.io/projected/ceee4161-e2bf-4b51-a428-0d00e26cc9a8-kube-api-access-4vkhh\") pod \"ovnkube-node-ntbvk\" (UID: \"ceee4161-e2bf-4b51-a428-0d00e26cc9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.565088 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.565067    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brmnz\" (UniqueName: \"kubernetes.io/projected/13171d83-fc1e-4f9b-b75a-edadb8cff3da-kube-api-access-brmnz\") pod \"node-ca-lfrbv\" (UID: \"13171d83-fc1e-4f9b-b75a-edadb8cff3da\") " pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.609691 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.609671    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:42.658233 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-system-cni-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.658354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c8f16ac-746a-474f-ae8a-76c16a64aec1-cni-binary-copy\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.658354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-systemd\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.658354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658285    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-cni-multus\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.658354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-sys\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.658354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.658354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-modprobe-d\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.658354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658354    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-tmp\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzxdj\" (UniqueName: \"kubernetes.io/projected/2564df60-c9eb-4e85-82df-d44f54880bbb-kube-api-access-bzxdj\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658397    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658430    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-daemon-config\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658467    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658492    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-cni-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysconfig\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-var-lib-kubelet\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658558    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-tuned\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658582    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-hosts-file\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658622    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjx8\" (UniqueName: \"kubernetes.io/projected/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-kube-api-access-6vjx8\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658644    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-system-cni-dir\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-host-slash\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.658709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-multus-certs\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-lib-modules\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-cni-bin\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-kubelet\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysctl-d\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-run\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658835    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-hostroot\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658862    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-tmp-dir\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658887    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-cnibin\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-host\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658919    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcqpm\" (UniqueName: \"kubernetes.io/projected/7c8f16ac-746a-474f-ae8a-76c16a64aec1-kube-api-access-kcqpm\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-cnibin\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.658993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-conf-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659018    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-socket-dir-parent\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659042    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-netns\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysctl-conf\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-iptables-alerter-script\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.659260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmnmr\" (UniqueName: \"kubernetes.io/projected/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-kube-api-access-dmnmr\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-kubernetes\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chvkp\" (UniqueName: \"kubernetes.io/projected/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-kube-api-access-chvkp\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-k8s-cni-cncf-io\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659178    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drlpt\" (UniqueName: \"kubernetes.io/projected/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-kube-api-access-drlpt\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-etc-kubernetes\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659272    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-etc-kubernetes\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659371    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-system-cni-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c8f16ac-746a-474f-ae8a-76c16a64aec1-cni-binary-copy\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.659988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.659965    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-systemd\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.660330 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.660003    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-cni-multus\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.660330 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.660043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-sys\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.660522 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.660499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.660634 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.660618    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-modprobe-d\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.660677 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.660666    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-kubelet\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.660729 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.660698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysctl-d\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.660767 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.660740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-run\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.660805 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.660775    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-hostroot\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.660980 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.660957    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:42.661043 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-tmp-dir\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.661043 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.661014    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs podName:8e72a897-0d80-4d6c-bf8b-ad1287fe621e nodeName:}" failed. No retries permitted until 2026-09-06 12:17:43.16099487 +0000 UTC m=+3.135042045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs") pod "network-metrics-daemon-dzk4s" (UID: "8e72a897-0d80-4d6c-bf8b-ad1287fe621e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:42.661121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-cnibin\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.661154 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661132    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-host\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.661556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661538    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.661556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661538    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-daemon-config\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.661721 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.661792 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-cnibin\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.661836 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661823    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-conf-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.661893 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-socket-dir-parent\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.661992 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.661917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-netns\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.662077 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662034    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysctl-conf\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.662129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662080    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2564df60-c9eb-4e85-82df-d44f54880bbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.662173 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-multus-cni-dir\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.662219 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662177    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-sysconfig\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.662262 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662216    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-var-lib-kubelet\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.662505 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662470    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-iptables-alerter-script\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.662650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662631    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-kubernetes\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.662718 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-var-lib-cni-bin\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.662774 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662710    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-hosts-file\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.662774 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662724    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-host-slash\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.662774 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-multus-certs\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.662915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662844    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-lib-modules\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.662915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662892    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2564df60-c9eb-4e85-82df-d44f54880bbb-system-cni-dir\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.663012 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.662949    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c8f16ac-746a-474f-ae8a-76c16a64aec1-host-run-k8s-cni-cncf-io\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.664928 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.664898    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-etc-tuned\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.665006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.664912    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-tmp\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.667117 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.667070    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:42.667117 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.667091    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:42.667117 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.667101    2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqghd for pod openshift-network-diagnostics/network-check-target-wfbzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:42.667281 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:42.667144    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd podName:cdd6f0e5-b216-42e2-983e-f9109aff23a7 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:43.167131694 +0000 UTC m=+3.141178872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hqghd" (UniqueName: "kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd") pod "network-check-target-wfbzs" (UID: "cdd6f0e5-b216-42e2-983e-f9109aff23a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:42.669707 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.669616    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chvkp\" (UniqueName: \"kubernetes.io/projected/8bc63c5b-5a75-4b05-8a13-91f85956bbd5-kube-api-access-chvkp\") pod \"tuned-wj6qs\" (UID: \"8bc63c5b-5a75-4b05-8a13-91f85956bbd5\") " pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.669707 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.669675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzxdj\" (UniqueName: \"kubernetes.io/projected/2564df60-c9eb-4e85-82df-d44f54880bbb-kube-api-access-bzxdj\") pod \"multus-additional-cni-plugins-rcvxx\" (UID: \"2564df60-c9eb-4e85-82df-d44f54880bbb\") " pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.669970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.669946    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcqpm\" (UniqueName: \"kubernetes.io/projected/7c8f16ac-746a-474f-ae8a-76c16a64aec1-kube-api-access-kcqpm\") pod \"multus-54lh8\" (UID: \"7c8f16ac-746a-474f-ae8a-76c16a64aec1\") " pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.670524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.670491    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmnmr\" (UniqueName: \"kubernetes.io/projected/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-kube-api-access-dmnmr\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:42.670907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.670887    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drlpt\" (UniqueName: \"kubernetes.io/projected/3ac8bc3d-8d03-46d8-847b-af27c70f9c53-kube-api-access-drlpt\") pod \"iptables-alerter-5w9k5\" (UID: \"3ac8bc3d-8d03-46d8-847b-af27c70f9c53\") " pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.670976 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.670964    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjx8\" (UniqueName: \"kubernetes.io/projected/e32fc3b0-b1a7-4e08-83e7-3779065e0a6e-kube-api-access-6vjx8\") pod \"node-resolver-59v9r\" (UID: \"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e\") " pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:42.742806 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.742780    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz"
Sep 06 12:17:42.750293 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.750275    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lfrbv"
Sep 06 12:17:42.760764 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.760736    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:17:42.766149 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.766128    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:17:42.772482 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.772463    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-54lh8"
Sep 06 12:17:42.778846 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.778830    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rcvxx"
Sep 06 12:17:42.787109 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.787092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5w9k5"
Sep 06 12:17:42.791408 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.791391    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wj6qs"
Sep 06 12:17:42.796743 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:42.796725    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59v9r"
Sep 06 12:17:43.062335 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.062254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:43.062445 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.062386    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:43.062445 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.062439    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret podName:bfe89a28-bbb4-475f-8219-d93d063bc226 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:44.062424351 +0000 UTC m=+4.036471525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret") pod "global-pull-secret-syncer-g6tjq" (UID: "bfe89a28-bbb4-475f-8219-d93d063bc226") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:43.163375 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.163347    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:43.163496 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.163455    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:43.163532 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.163499    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs podName:8e72a897-0d80-4d6c-bf8b-ad1287fe621e nodeName:}" failed. No retries permitted until 2026-09-06 12:17:44.163486116 +0000 UTC m=+4.137533277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs") pod "network-metrics-daemon-dzk4s" (UID: "8e72a897-0d80-4d6c-bf8b-ad1287fe621e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:43.264188 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.264159    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:43.264331 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.264295    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:43.264331 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.264312    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:43.264331 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.264322    2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqghd for pod openshift-network-diagnostics/network-check-target-wfbzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:43.264454 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.264376    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd podName:cdd6f0e5-b216-42e2-983e-f9109aff23a7 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:44.264360534 +0000 UTC m=+4.238407714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqghd" (UniqueName: "kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd") pod "network-check-target-wfbzs" (UID: "cdd6f0e5-b216-42e2-983e-f9109aff23a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:43.332883 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.332862    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2564df60_c9eb_4e85_82df_d44f54880bbb.slice/crio-fec7d5636362a7ee0b765e34f21f9b57880d7f2d06662590587ffd76aca50da6 WatchSource:0}: Error finding container fec7d5636362a7ee0b765e34f21f9b57880d7f2d06662590587ffd76aca50da6: Status 404 returned error can't find the container with id fec7d5636362a7ee0b765e34f21f9b57880d7f2d06662590587ffd76aca50da6
Sep 06 12:17:43.352006 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.351986    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32fc3b0_b1a7_4e08_83e7_3779065e0a6e.slice/crio-f9aa2e1d14e83a01211a8b9caadc0197040650f3237711f6a2bd1aee1f9f740e WatchSource:0}: Error finding container f9aa2e1d14e83a01211a8b9caadc0197040650f3237711f6a2bd1aee1f9f740e: Status 404 returned error can't find the container with id f9aa2e1d14e83a01211a8b9caadc0197040650f3237711f6a2bd1aee1f9f740e
Sep 06 12:17:43.352760 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.352742    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8f16ac_746a_474f_ae8a_76c16a64aec1.slice/crio-b6f715350299d8c2434193f8cc878c8cd249bb67a59b3418177d7c1eef716a3e WatchSource:0}: Error finding container b6f715350299d8c2434193f8cc878c8cd249bb67a59b3418177d7c1eef716a3e: Status 404 returned error can't find the container with id b6f715350299d8c2434193f8cc878c8cd249bb67a59b3418177d7c1eef716a3e
Sep 06 12:17:43.354480 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.354460    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac8bc3d_8d03_46d8_847b_af27c70f9c53.slice/crio-b4c0e2586198f980bcdeecff9770b0df9897d6e81a08c493ca318afba2caf173 WatchSource:0}: Error finding container b4c0e2586198f980bcdeecff9770b0df9897d6e81a08c493ca318afba2caf173: Status 404 returned error can't find the container with id b4c0e2586198f980bcdeecff9770b0df9897d6e81a08c493ca318afba2caf173
Sep 06 12:17:43.355478 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.355462    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13171d83_fc1e_4f9b_b75a_edadb8cff3da.slice/crio-9b139904835050ede4682c5648937eda09d86fc627b1f1b6bd1f880eb3197fd9 WatchSource:0}: Error finding container 9b139904835050ede4682c5648937eda09d86fc627b1f1b6bd1f880eb3197fd9: Status 404 returned error can't find the container with id 9b139904835050ede4682c5648937eda09d86fc627b1f1b6bd1f880eb3197fd9
Sep 06 12:17:43.361390 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.361305    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407ae861_c297_4742_a20b_89a7b99fdf8d.slice/crio-a3808e58d4ab86c67255e0c3ebb4761a209922092ac5fd7e47d7df2194d6aca4 WatchSource:0}: Error finding container a3808e58d4ab86c67255e0c3ebb4761a209922092ac5fd7e47d7df2194d6aca4: Status 404 returned error can't find the container with id a3808e58d4ab86c67255e0c3ebb4761a209922092ac5fd7e47d7df2194d6aca4
Sep 06 12:17:43.362064 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.362046    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceee4161_e2bf_4b51_a428_0d00e26cc9a8.slice/crio-ab1fb91b021253ea53593343c8332f27d47c851ea5464b1989f8cb750523cc41 WatchSource:0}: Error finding container ab1fb91b021253ea53593343c8332f27d47c851ea5464b1989f8cb750523cc41: Status 404 returned error can't find the container with id ab1fb91b021253ea53593343c8332f27d47c851ea5464b1989f8cb750523cc41
Sep 06 12:17:43.362870 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.362850    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d4a411_4b50_431e_9719_f9c92e0064b2.slice/crio-b84be25c7f70a042894c36c06841ebd3d0eed1470b481ecf8419be4ed4cb3c6e WatchSource:0}: Error finding container b84be25c7f70a042894c36c06841ebd3d0eed1470b481ecf8419be4ed4cb3c6e: Status 404 returned error can't find the container with id b84be25c7f70a042894c36c06841ebd3d0eed1470b481ecf8419be4ed4cb3c6e
Sep 06 12:17:43.363924 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:17:43.363575    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc63c5b_5a75_4b05_8a13_91f85956bbd5.slice/crio-af897922a72d827f8beb13e76b1d74fe0d4e9cdcfd0c053c3d0a9f9a0dd6fbbb WatchSource:0}: Error finding container af897922a72d827f8beb13e76b1d74fe0d4e9cdcfd0c053c3d0a9f9a0dd6fbbb: Status 404 returned error can't find the container with id af897922a72d827f8beb13e76b1d74fe0d4e9cdcfd0c053c3d0a9f9a0dd6fbbb
Sep 06 12:17:43.480735 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.480710    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 12:12:42 +0000 UTC" deadline="2028-02-07 13:34:32.284097023 +0000 UTC"
Sep 06 12:17:43.480735 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.480733    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12457h16m48.803366055s"
Sep 06 12:17:43.509049 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.509031    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:43.509129 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.509108    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:43.509169 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.509137    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:43.509207 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:43.509198    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:43.519193 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.519173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"ab1fb91b021253ea53593343c8332f27d47c851ea5464b1989f8cb750523cc41"}
Sep 06 12:17:43.520226 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.520208    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4mmjh" event={"ID":"22d4a411-4b50-431e-9719-f9c92e0064b2","Type":"ContainerStarted","Data":"b84be25c7f70a042894c36c06841ebd3d0eed1470b481ecf8419be4ed4cb3c6e"}
Sep 06 12:17:43.521238 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.521218    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lfrbv" event={"ID":"13171d83-fc1e-4f9b-b75a-edadb8cff3da","Type":"ContainerStarted","Data":"9b139904835050ede4682c5648937eda09d86fc627b1f1b6bd1f880eb3197fd9"}
Sep 06 12:17:43.522248 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.522223    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5w9k5" event={"ID":"3ac8bc3d-8d03-46d8-847b-af27c70f9c53","Type":"ContainerStarted","Data":"b4c0e2586198f980bcdeecff9770b0df9897d6e81a08c493ca318afba2caf173"}
Sep 06 12:17:43.523186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.523170    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59v9r" event={"ID":"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e","Type":"ContainerStarted","Data":"f9aa2e1d14e83a01211a8b9caadc0197040650f3237711f6a2bd1aee1f9f740e"}
Sep 06 12:17:43.524110 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.524096    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerStarted","Data":"fec7d5636362a7ee0b765e34f21f9b57880d7f2d06662590587ffd76aca50da6"}
Sep 06 12:17:43.525834 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.525814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" event={"ID":"d6303ebc88473edaa1e2fd9f6ceeefbf","Type":"ContainerStarted","Data":"6787cde502814f894c125239a25d64f9f864088dcbb845dafbb6ab53d396ebe5"}
Sep 06 12:17:43.529975 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.529954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wj6qs" event={"ID":"8bc63c5b-5a75-4b05-8a13-91f85956bbd5","Type":"ContainerStarted","Data":"af897922a72d827f8beb13e76b1d74fe0d4e9cdcfd0c053c3d0a9f9a0dd6fbbb"}
Sep 06 12:17:43.531007 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.530985    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz" event={"ID":"407ae861-c297-4742-a20b-89a7b99fdf8d","Type":"ContainerStarted","Data":"a3808e58d4ab86c67255e0c3ebb4761a209922092ac5fd7e47d7df2194d6aca4"}
Sep 06 12:17:43.531899 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.531883    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-54lh8" event={"ID":"7c8f16ac-746a-474f-ae8a-76c16a64aec1","Type":"ContainerStarted","Data":"b6f715350299d8c2434193f8cc878c8cd249bb67a59b3418177d7c1eef716a3e"}
Sep 06 12:17:43.538172 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:43.538143    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" podStartSLOduration=2.538130281 podStartE2EDuration="2.538130281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:17:43.538103323 +0000 UTC m=+3.512150506" watchObservedRunningTime="2026-09-06 12:17:43.538130281 +0000 UTC m=+3.512177462"
Sep 06 12:17:44.070301 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.070214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:44.070457 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.070375    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:44.070457 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.070449    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret podName:bfe89a28-bbb4-475f-8219-d93d063bc226 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:46.070428534 +0000 UTC m=+6.044475702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret") pod "global-pull-secret-syncer-g6tjq" (UID: "bfe89a28-bbb4-475f-8219-d93d063bc226") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:44.170874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.170841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:44.171076 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.171042    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:44.171161 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.171102    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs podName:8e72a897-0d80-4d6c-bf8b-ad1287fe621e nodeName:}" failed. No retries permitted until 2026-09-06 12:17:46.171083858 +0000 UTC m=+6.145131026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs") pod "network-metrics-daemon-dzk4s" (UID: "8e72a897-0d80-4d6c-bf8b-ad1287fe621e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:44.271993 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.271960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:44.272172 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.272152    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:44.272250 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.272184    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:44.272250 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.272198    2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqghd for pod openshift-network-diagnostics/network-check-target-wfbzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:44.272357 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.272252    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd podName:cdd6f0e5-b216-42e2-983e-f9109aff23a7 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:46.272235436 +0000 UTC m=+6.246282616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqghd" (UniqueName: "kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd") pod "network-check-target-wfbzs" (UID: "cdd6f0e5-b216-42e2-983e-f9109aff23a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:44.444193 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.444163    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:44.481352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.481197    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 12:12:42 +0000 UTC" deadline="2028-03-11 17:49:46.932248909 +0000 UTC"
Sep 06 12:17:44.481352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.481249    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13253h32m2.451004912s"
Sep 06 12:17:44.511646 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.511623    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:44.511765 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:44.511736    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:44.538856 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.538828    2568 generic.go:356] "Generic (PLEG): container finished" podID="455915a86d33fb89c073fa9c973de3d3" containerID="488d8495ec83e2b76ae04a6a73a2bb41e79d7bade8e8917cc0be0f2b462e12f3" exitCode=0
Sep 06 12:17:44.539724 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:44.539700    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"455915a86d33fb89c073fa9c973de3d3","Type":"ContainerDied","Data":"488d8495ec83e2b76ae04a6a73a2bb41e79d7bade8e8917cc0be0f2b462e12f3"}
Sep 06 12:17:45.509364 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:45.509239    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:45.509792 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:45.509364    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:45.509792 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:45.509764    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:45.509915 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:45.509867    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:45.551678 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:45.551618    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"455915a86d33fb89c073fa9c973de3d3","Type":"ContainerStarted","Data":"99530849da983963735a4b26768a0b99f420a5c37c6c3ce07ef64267eb1c1e84"}
Sep 06 12:17:46.088640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:46.087889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:46.088640 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.088094    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:46.088640 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.088157    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret podName:bfe89a28-bbb4-475f-8219-d93d063bc226 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:50.088137879 +0000 UTC m=+10.062185047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret") pod "global-pull-secret-syncer-g6tjq" (UID: "bfe89a28-bbb4-475f-8219-d93d063bc226") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:46.189878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:46.189168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:46.189878 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.189343    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:46.189878 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.189405    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs podName:8e72a897-0d80-4d6c-bf8b-ad1287fe621e nodeName:}" failed. No retries permitted until 2026-09-06 12:17:50.189386789 +0000 UTC m=+10.163433956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs") pod "network-metrics-daemon-dzk4s" (UID: "8e72a897-0d80-4d6c-bf8b-ad1287fe621e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:46.290140 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:46.289548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:46.290140 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.289722    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:46.290140 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.289744    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:46.290140 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.289756    2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqghd for pod openshift-network-diagnostics/network-check-target-wfbzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:46.290140 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.289818    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd podName:cdd6f0e5-b216-42e2-983e-f9109aff23a7 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:50.289801512 +0000 UTC m=+10.263848674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqghd" (UniqueName: "kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd") pod "network-check-target-wfbzs" (UID: "cdd6f0e5-b216-42e2-983e-f9109aff23a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:46.518955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:46.518438    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:46.518955 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:46.518555    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:47.509393 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:47.509350    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:47.509546 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:47.509466    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:47.509719 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:47.509683    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:47.509814 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:47.509780    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:48.509116 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:48.509086    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:48.509585 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:48.509222    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:49.509578 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:49.509342    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:49.509578 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:49.509557    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:49.510084 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:49.509888    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:49.510084 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:49.509915    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:50.122154 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:50.122106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:50.122329 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.122272    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:50.122329 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.122321    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret podName:bfe89a28-bbb4-475f-8219-d93d063bc226 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:58.12230874 +0000 UTC m=+18.096355902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret") pod "global-pull-secret-syncer-g6tjq" (UID: "bfe89a28-bbb4-475f-8219-d93d063bc226") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:50.223325 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:50.223283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:50.223483 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.223415    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:50.223539 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.223494    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs podName:8e72a897-0d80-4d6c-bf8b-ad1287fe621e nodeName:}" failed. No retries permitted until 2026-09-06 12:17:58.223471721 +0000 UTC m=+18.197518891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs") pod "network-metrics-daemon-dzk4s" (UID: "8e72a897-0d80-4d6c-bf8b-ad1287fe621e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:50.324925 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:50.324346    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:50.324925 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.324515    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:50.324925 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.324535    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:50.324925 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.324549    2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqghd for pod openshift-network-diagnostics/network-check-target-wfbzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:50.324925 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.324624    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd podName:cdd6f0e5-b216-42e2-983e-f9109aff23a7 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:58.324588424 +0000 UTC m=+18.298635593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqghd" (UniqueName: "kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd") pod "network-check-target-wfbzs" (UID: "cdd6f0e5-b216-42e2-983e-f9109aff23a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:50.510817 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:50.510416    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:50.510817 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:50.510501    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:51.508966 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:51.508934    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:51.509125 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:51.509054    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:51.509125 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:51.509091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:51.509260 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:51.509160    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:52.509163 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:52.509138    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:52.509577 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:52.509243    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:53.509439 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:53.509414    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:53.509729 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:53.509445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:53.509729 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:53.509528    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:53.509729 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:53.509656    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:54.509272 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:54.509244    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:54.509457 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:54.509359    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:55.509397 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:55.509354    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:55.509585 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:55.509491    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:55.509585 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:55.509552    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:55.509985 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:55.509673    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:56.509506 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:56.509474    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:56.509703 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:56.509617    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:57.509073 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:57.509041    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:57.509295 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:57.509050    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:57.509295 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:57.509207    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:57.509295 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:57.509229    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:17:58.184367 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:58.184335    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:58.184792 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.184518    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:58.184792 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.184593    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret podName:bfe89a28-bbb4-475f-8219-d93d063bc226 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.184572016 +0000 UTC m=+34.158619196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret") pod "global-pull-secret-syncer-g6tjq" (UID: "bfe89a28-bbb4-475f-8219-d93d063bc226") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:58.284821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:58.284788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:58.284976 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.284914    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:58.285021 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.284980    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs podName:8e72a897-0d80-4d6c-bf8b-ad1287fe621e nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.284959355 +0000 UTC m=+34.259006518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs") pod "network-metrics-daemon-dzk4s" (UID: "8e72a897-0d80-4d6c-bf8b-ad1287fe621e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:58.385532 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:58.385505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:58.385691 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.385663    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:58.385691 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.385683    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:58.385691 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.385692    2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqghd for pod openshift-network-diagnostics/network-check-target-wfbzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:58.385824 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.385749    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd podName:cdd6f0e5-b216-42e2-983e-f9109aff23a7 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.385734943 +0000 UTC m=+34.359782123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqghd" (UniqueName: "kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd") pod "network-check-target-wfbzs" (UID: "cdd6f0e5-b216-42e2-983e-f9109aff23a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:58.509229 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:58.509202    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:17:58.509423 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:58.509350    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:17:59.508952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:59.508927    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:17:59.509423 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:59.509050    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:17:59.509423 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:17:59.509100    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:17:59.509423 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:17:59.509217    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:18:00.509493 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:00.509460    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:00.509874 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:00.509567    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:18:01.509048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.509020    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:01.509150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.509020    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:01.509150 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:01.509135    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:18:01.509250 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:01.509214    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:18:01.581944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.581905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wj6qs" event={"ID":"8bc63c5b-5a75-4b05-8a13-91f85956bbd5","Type":"ContainerStarted","Data":"c5bd701367e9e4367e15eb9d46cddb7f66b7d8d31dec5a7acaa8c9bade5fc090"}
Sep 06 12:18:01.583369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.583347    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz" event={"ID":"407ae861-c297-4742-a20b-89a7b99fdf8d","Type":"ContainerStarted","Data":"6c0dcdefee1a3bfbd3b3f361383d5afc56f27c7ef56306d5ba5ff550eb1c1df1"}
Sep 06 12:18:01.584755 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.584730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-54lh8" event={"ID":"7c8f16ac-746a-474f-ae8a-76c16a64aec1","Type":"ContainerStarted","Data":"547b6bac078061d7844cceaa657768df6284ab7eedc1ca4dc101a932304b2283"}
Sep 06 12:18:01.586060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.586034    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4mmjh" event={"ID":"22d4a411-4b50-431e-9719-f9c92e0064b2","Type":"ContainerStarted","Data":"52f3f88b244118b8c60a9520d1977386b8b91fe710cbb8ca072dfc6e667ad784"}
Sep 06 12:18:01.588025 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.587993    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lfrbv" event={"ID":"13171d83-fc1e-4f9b-b75a-edadb8cff3da","Type":"ContainerStarted","Data":"055e70573bc828a548cf0f41496221bc7965ec5ba9b7ef2a42aaed48a8d69a1a"}
Sep 06 12:18:01.589565 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.589544    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59v9r" event={"ID":"e32fc3b0-b1a7-4e08-83e7-3779065e0a6e","Type":"ContainerStarted","Data":"06f3f0c6806ff6147b4b6d70c34faf19b75e6429dd5121ab2cb9faadb3245a9c"}
Sep 06 12:18:01.591141 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.591117    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerStarted","Data":"e794e45ea7c999024a8349be19e716214f768a9cdc419c3698f9efcecc5ea77d"}
Sep 06 12:18:01.595536 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.595326    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" podStartSLOduration=20.595316125 podStartE2EDuration="20.595316125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:17:45.564992323 +0000 UTC m=+5.539039509" watchObservedRunningTime="2026-09-06 12:18:01.595316125 +0000 UTC m=+21.569363309"
Sep 06 12:18:01.611666 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.611591    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wj6qs" podStartSLOduration=3.680163174 podStartE2EDuration="21.611574475s" totalImagesPullingTime="17.931411301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:01.595789723 +0000 UTC m=+21.569836909" watchObservedRunningTime="2026-09-06 12:18:01.611574475 +0000 UTC m=+21.585621657"
Sep 06 12:18:01.611888 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.611843    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lfrbv" podStartSLOduration=3.67610108 podStartE2EDuration="21.611834025s" totalImagesPullingTime="17.935732945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:01.611743788 +0000 UTC m=+21.585790965" watchObservedRunningTime="2026-09-06 12:18:01.611834025 +0000 UTC m=+21.585881220"
Sep 06 12:18:01.623973 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.623904    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4mmjh" podStartSLOduration=7.9683709910000005 podStartE2EDuration="21.623894396s" totalImagesPullingTime="13.655523405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:01.623782693 +0000 UTC m=+21.597829963" watchObservedRunningTime="2026-09-06 12:18:01.623894396 +0000 UTC m=+21.597941578"
Sep 06 12:18:01.641422 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.640754    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-54lh8" podStartSLOduration=3.662393711 podStartE2EDuration="21.640739279s" totalImagesPullingTime="17.978345568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:01.640719381 +0000 UTC m=+21.614766567" watchObservedRunningTime="2026-09-06 12:18:01.640739279 +0000 UTC m=+21.614786465"
Sep 06 12:18:01.669150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:01.669101    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-59v9r" podStartSLOduration=3.743366816 podStartE2EDuration="21.669086512s" totalImagesPullingTime="17.925719696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:01.668853617 +0000 UTC m=+21.642900802" watchObservedRunningTime="2026-09-06 12:18:01.669086512 +0000 UTC m=+21.643133697"
Sep 06 12:18:02.509589 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.509458    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:02.509709 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:02.509681    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:18:02.549903 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.549708    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 12:18:02.596643 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.596575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"89784727b21a3dc3d9a882eb9d0ac3348f03c179cee80553527e353d5771ddae"}
Sep 06 12:18:02.597186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.596675    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"42ad7894ce3856213d27614cedc6b47b71f45765628becea5c4a51d1e5097e0a"}
Sep 06 12:18:02.597186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.596728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"56a9780ec8bacd67ccca753a00654ee72a568106031e6265c33a001cd01605a9"}
Sep 06 12:18:02.597186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.596774    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"42439e5c879f28e1d71e4c60436eeba1f810b281f1fc30b83f8971eceef796da"}
Sep 06 12:18:02.597186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.596821    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"f53de5bd2a7e5133fc60f79bc7834b7b898d52b632b73eb0fd24c45d75bc4dfd"}
Sep 06 12:18:02.597186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.596859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"f3017e9d6aff9c393e409cf1863386c343fdd91574fd1c540c143c6bbddc5c4e"}
Sep 06 12:18:02.598164 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.598140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5w9k5" event={"ID":"3ac8bc3d-8d03-46d8-847b-af27c70f9c53","Type":"ContainerStarted","Data":"45a001406ff9e2cfa1d3547e220864d7fc10b8a87edc9b010f10a29cd4c7d20f"}
Sep 06 12:18:02.599535 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.599515    2568 generic.go:356] "Generic (PLEG): container finished" podID="2564df60-c9eb-4e85-82df-d44f54880bbb" containerID="e794e45ea7c999024a8349be19e716214f768a9cdc419c3698f9efcecc5ea77d" exitCode=0
Sep 06 12:18:02.599641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.599591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerDied","Data":"e794e45ea7c999024a8349be19e716214f768a9cdc419c3698f9efcecc5ea77d"}
Sep 06 12:18:02.601469 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.601446    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz" event={"ID":"407ae861-c297-4742-a20b-89a7b99fdf8d","Type":"ContainerStarted","Data":"9a015988147dab929cca329504a26ad89bfef260ea465ba55a7a889e2b03961f"}
Sep 06 12:18:02.610471 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:02.610434    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5w9k5" podStartSLOduration=4.67062493 podStartE2EDuration="22.610421065s" totalImagesPullingTime="17.939796135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:02.610421239 +0000 UTC m=+22.584468425" watchObservedRunningTime="2026-09-06 12:18:02.610421065 +0000 UTC m=+22.584468250"
Sep 06 12:18:03.495960 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:03.495857    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T12:18:02.549900314Z","UUID":"1a2bc912-3905-471d-bcd1-231408097f5a","Handler":null,"Name":"","Endpoint":""}
Sep 06 12:18:03.497679 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:03.497658    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 12:18:03.497806 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:03.497689    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 12:18:03.508731 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:03.508706    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:03.508854 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:03.508832    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:18:03.509133 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:03.509117    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:03.509251 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:03.509207    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:18:04.509230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:04.509198    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:04.509657 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:04.509298    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:18:04.607827 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:04.607792    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz" event={"ID":"407ae861-c297-4742-a20b-89a7b99fdf8d","Type":"ContainerStarted","Data":"f5bf798f818ddb134268670ad4f8766e4405c5243ec1da58d8cc5279c27a7dda"}
Sep 06 12:18:04.611734 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:04.611708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"dadf2971e52a4a0aa8876dc4248ebc19086111fd9741e5b2dfee7356407fede8"}
Sep 06 12:18:04.625634 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:04.625347    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hskdz" podStartSLOduration=4.699882497 podStartE2EDuration="24.625333673s" totalImagesPullingTime="19.925451176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:04.625308102 +0000 UTC m=+24.599355299" watchObservedRunningTime="2026-09-06 12:18:04.625333673 +0000 UTC m=+24.599380852"
Sep 06 12:18:05.508957 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:05.508928    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:05.509141 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:05.509044    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:18:05.509315 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:05.509294    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:05.509711 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:05.509458    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:18:06.369449 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:06.369375    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:18:06.369995 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:06.369973    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:18:06.508695 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:06.508675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:06.508810 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:06.508790    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:18:06.619088 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:06.618953    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerStarted","Data":"59ba99acc72d95b3b85aa8efdca0e3f82a6a1c8c7754c5abc0bd0b7df601475f"}
Sep 06 12:18:06.623719 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:06.623638    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" event={"ID":"ceee4161-e2bf-4b51-a428-0d00e26cc9a8","Type":"ContainerStarted","Data":"631aab0c24195eb20f1e1d9bffb27907f7e6beef7ea4e5a6e6470cad9a0c0b11"}
Sep 06 12:18:06.623914 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:06.623897    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:18:06.660848 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:06.660792    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk" podStartSLOduration=8.427721119 podStartE2EDuration="26.660776446s" totalImagesPullingTime="18.233055327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:06.659561962 +0000 UTC m=+26.633609148" watchObservedRunningTime="2026-09-06 12:18:06.660776446 +0000 UTC m=+26.634823648"
Sep 06 12:18:07.509052 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:07.509025    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:07.509173 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:07.509118    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:18:07.509216 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:07.509171    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:07.509264 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:07.509249    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:18:07.627441 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:07.627416    2568 generic.go:356] "Generic (PLEG): container finished" podID="2564df60-c9eb-4e85-82df-d44f54880bbb" containerID="59ba99acc72d95b3b85aa8efdca0e3f82a6a1c8c7754c5abc0bd0b7df601475f" exitCode=0
Sep 06 12:18:07.627899 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:07.627495    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerDied","Data":"59ba99acc72d95b3b85aa8efdca0e3f82a6a1c8c7754c5abc0bd0b7df601475f"}
Sep 06 12:18:07.627987 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:07.627965    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:18:07.628134 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:07.628039    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:18:07.643556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:07.643539    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:18:07.643711 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:07.643694    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:18:08.497988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.497957    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dzk4s"]
Sep 06 12:18:08.498145 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.498095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:08.498571 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:08.498221    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:18:08.500536 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.500513    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g6tjq"]
Sep 06 12:18:08.500659 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.500562    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfbzs"]
Sep 06 12:18:08.500659 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.500640    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:08.500778 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:08.500726    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:18:08.500830 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.500792    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:08.500884 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:08.500865    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:18:08.998380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.998354    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:18:08.998970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.998492    2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 06 12:18:08.999159 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:08.998981    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4mmjh"
Sep 06 12:18:09.634221 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:09.634191    2568 generic.go:356] "Generic (PLEG): container finished" podID="2564df60-c9eb-4e85-82df-d44f54880bbb" containerID="4bb0e4e0375d9299e0e1c0a3f3c54933830c05186366c57b5cc66b476edb1d4b" exitCode=0
Sep 06 12:18:09.634380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:09.634243    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerDied","Data":"4bb0e4e0375d9299e0e1c0a3f3c54933830c05186366c57b5cc66b476edb1d4b"}
Sep 06 12:18:10.510325 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:10.510260    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:10.510674 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:10.510380    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:10.510674 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:10.510408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:10.510674 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:10.510372    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:18:10.510674 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:10.510473    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:18:10.510674 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:10.510539    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:18:10.638631 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:10.638586    2568 generic.go:356] "Generic (PLEG): container finished" podID="2564df60-c9eb-4e85-82df-d44f54880bbb" containerID="94d8c07ad1edd6aa85ede4c9c631ccf7d0fcb3da3adbb15ebf6671a37bd3ac4a" exitCode=0
Sep 06 12:18:10.638724 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:10.638633    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerDied","Data":"94d8c07ad1edd6aa85ede4c9c631ccf7d0fcb3da3adbb15ebf6671a37bd3ac4a"}
Sep 06 12:18:12.509118 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:12.509087    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:12.509118 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:12.509102    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:12.509782 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:12.509213    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6tjq" podUID="bfe89a28-bbb4-475f-8219-d93d063bc226"
Sep 06 12:18:12.509782 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:12.509257    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:12.509782 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:12.509376    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzk4s" podUID="8e72a897-0d80-4d6c-bf8b-ad1287fe621e"
Sep 06 12:18:12.509782 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:12.509449    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfbzs" podUID="cdd6f0e5-b216-42e2-983e-f9109aff23a7"
Sep 06 12:18:13.870902 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:13.870864    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:13.947024 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:13.946977    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:14.000051 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.000019    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:14.208363 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.208338    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:14.208493 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.208458    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:18:14.208552 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.208523    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret podName:bfe89a28-bbb4-475f-8219-d93d063bc226 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:46.208503829 +0000 UTC m=+66.182551009 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret") pod "global-pull-secret-syncer-g6tjq" (UID: "bfe89a28-bbb4-475f-8219-d93d063bc226") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:18:14.309520 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.309490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:14.309700 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.309651    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:18:14.309771 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.309719    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs podName:8e72a897-0d80-4d6c-bf8b-ad1287fe621e nodeName:}" failed. No retries permitted until 2026-09-06 12:18:46.309698472 +0000 UTC m=+66.283745648 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs") pod "network-metrics-daemon-dzk4s" (UID: "8e72a897-0d80-4d6c-bf8b-ad1287fe621e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:18:14.313284 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.313263    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeReady"
Sep 06 12:18:14.313393 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.313384    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 12:18:14.347227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.346484    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bbb69666-vx2nt"]
Sep 06 12:18:14.377835 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.377809    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5tlns"]
Sep 06 12:18:14.377962 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.377934    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.380420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.380207    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 06 12:18:14.380420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.380273    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 06 12:18:14.380710 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.380690    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 06 12:18:14.380801 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.380751    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jx6gc\""
Sep 06 12:18:14.385615 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.385579    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 06 12:18:14.393679 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.393653    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rv585"]
Sep 06 12:18:14.393792 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.393779    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5tlns"
Sep 06 12:18:14.395910 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.395888    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 12:18:14.396022 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.395895    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 12:18:14.396022 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.395951    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 12:18:14.396022 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.395978    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nkgs4\""
Sep 06 12:18:14.410869 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.410850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:14.411010 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.410970    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:18:14.411010 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.410989    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:18:14.411010 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.411000    2568 projected.go:196] Error preparing data for projected volume kube-api-access-hqghd for pod openshift-network-diagnostics/network-check-target-wfbzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:18:14.411134 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.411059    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd podName:cdd6f0e5-b216-42e2-983e-f9109aff23a7 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:46.411041968 +0000 UTC m=+66.385089135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqghd" (UniqueName: "kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd") pod "network-check-target-wfbzs" (UID: "cdd6f0e5-b216-42e2-983e-f9109aff23a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:18:14.411870 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.411851    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bbb69666-vx2nt"]
Sep 06 12:18:14.411952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.411897    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5tlns"]
Sep 06 12:18:14.411952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.411919    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rv585"]
Sep 06 12:18:14.411952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.411940    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.413683 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.413651    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 12:18:14.413786 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.413759    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 12:18:14.413851 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.413769    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2nk9\""
Sep 06 12:18:14.509402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.509306    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:14.509402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.509346    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:14.509402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.509306    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:14.511206 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db9dffc-e714-49ad-b065-f3d1ce3a3562-tmp-dir\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.511324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511239    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-image-registry-private-configuration\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.511324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511281    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-installation-pull-secrets\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.511463 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-trusted-ca\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.511463 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511369    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db9dffc-e714-49ad-b065-f3d1ce3a3562-config-volume\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.511463 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511429    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.511463 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a5eb2a6-479d-4724-b6ac-b6ad73012557-ca-trust-extracted\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511478    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511503    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-bound-sa-token\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-certificates\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511556    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36004a4-1edb-4a53-b195-19e6823b1cde-cert\") pod \"ingress-canary-5tlns\" (UID: \"f36004a4-1edb-4a53-b195-19e6823b1cde\") " pod="openshift-ingress-canary/ingress-canary-5tlns"
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511585    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz8tn\" (UniqueName: \"kubernetes.io/projected/f36004a4-1edb-4a53-b195-19e6823b1cde-kube-api-access-dz8tn\") pod \"ingress-canary-5tlns\" (UID: \"f36004a4-1edb-4a53-b195-19e6823b1cde\") " pod="openshift-ingress-canary/ingress-canary-5tlns"
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511629    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6c9q\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-kube-api-access-p6c9q\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.511697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511671    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfzsq\" (UniqueName: \"kubernetes.io/projected/0db9dffc-e714-49ad-b065-f3d1ce3a3562-kube-api-access-rfzsq\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.512141 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511564    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 12:18:14.512141 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511868    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrr2p\""
Sep 06 12:18:14.512141 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.511959    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 12:18:14.512241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.512179    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vrsdl\""
Sep 06 12:18:14.612365 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612340    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.612365 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612366    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a5eb2a6-479d-4724-b6ac-b6ad73012557-ca-trust-extracted\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.612584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.612584 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.612474    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:14.612584 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.612477    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:14.612584 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.612490    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbb69666-vx2nt: secret "image-registry-tls" not found
Sep 06 12:18:14.612584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612539    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-bound-sa-token\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.612584 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.612553    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls podName:4a5eb2a6-479d-4724-b6ac-b6ad73012557 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:15.112532544 +0000 UTC m=+35.086579708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls") pod "image-registry-5bbb69666-vx2nt" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557") : secret "image-registry-tls" not found
Sep 06 12:18:14.612584 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:14.612573    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls podName:0db9dffc-e714-49ad-b065-f3d1ce3a3562 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:15.112563776 +0000 UTC m=+35.086610940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls") pod "dns-default-rv585" (UID: "0db9dffc-e714-49ad-b065-f3d1ce3a3562") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-certificates\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36004a4-1edb-4a53-b195-19e6823b1cde-cert\") pod \"ingress-canary-5tlns\" (UID: \"f36004a4-1edb-4a53-b195-19e6823b1cde\") " pod="openshift-ingress-canary/ingress-canary-5tlns"
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz8tn\" (UniqueName: \"kubernetes.io/projected/f36004a4-1edb-4a53-b195-19e6823b1cde-kube-api-access-dz8tn\") pod \"ingress-canary-5tlns\" (UID: \"f36004a4-1edb-4a53-b195-19e6823b1cde\") " pod="openshift-ingress-canary/ingress-canary-5tlns"
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6c9q\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-kube-api-access-p6c9q\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612751    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a5eb2a6-479d-4724-b6ac-b6ad73012557-ca-trust-extracted\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612798    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfzsq\" (UniqueName: \"kubernetes.io/projected/0db9dffc-e714-49ad-b065-f3d1ce3a3562-kube-api-access-rfzsq\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612845    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db9dffc-e714-49ad-b065-f3d1ce3a3562-tmp-dir\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-image-registry-private-configuration\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.612950 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-installation-pull-secrets\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.613342 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.612961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-trusted-ca\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.613342 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.613137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db9dffc-e714-49ad-b065-f3d1ce3a3562-config-volume\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.613342 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.613211    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db9dffc-e714-49ad-b065-f3d1ce3a3562-tmp-dir\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.613342 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.613241    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-certificates\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.613757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.613698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db9dffc-e714-49ad-b065-f3d1ce3a3562-config-volume\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.613837 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.613779    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-trusted-ca\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.616648 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.616627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-image-registry-private-configuration\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.616736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.616690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-installation-pull-secrets\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.616799 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.616786    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36004a4-1edb-4a53-b195-19e6823b1cde-cert\") pod \"ingress-canary-5tlns\" (UID: \"f36004a4-1edb-4a53-b195-19e6823b1cde\") " pod="openshift-ingress-canary/ingress-canary-5tlns"
Sep 06 12:18:14.620474 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.620449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfzsq\" (UniqueName: \"kubernetes.io/projected/0db9dffc-e714-49ad-b065-f3d1ce3a3562-kube-api-access-rfzsq\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:14.620868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.620851    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz8tn\" (UniqueName: \"kubernetes.io/projected/f36004a4-1edb-4a53-b195-19e6823b1cde-kube-api-access-dz8tn\") pod \"ingress-canary-5tlns\" (UID: \"f36004a4-1edb-4a53-b195-19e6823b1cde\") " pod="openshift-ingress-canary/ingress-canary-5tlns"
Sep 06 12:18:14.621504 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.621479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6c9q\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-kube-api-access-p6c9q\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.621875 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.621857    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-bound-sa-token\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:14.702800 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:14.702781    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5tlns"
Sep 06 12:18:15.017147 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:15.016880    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5tlns"]
Sep 06 12:18:15.117653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:15.117627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:15.117768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:15.117663    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:15.117804 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:15.117788    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:15.117804 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:15.117786    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:15.117867 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:15.117810    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbb69666-vx2nt: secret "image-registry-tls" not found
Sep 06 12:18:15.117867 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:15.117837    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls podName:0db9dffc-e714-49ad-b065-f3d1ce3a3562 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:16.117823957 +0000 UTC m=+36.091871120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls") pod "dns-default-rv585" (UID: "0db9dffc-e714-49ad-b065-f3d1ce3a3562") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:15.117867 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:15.117856    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls podName:4a5eb2a6-479d-4724-b6ac-b6ad73012557 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:16.117843848 +0000 UTC m=+36.091891011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls") pod "image-registry-5bbb69666-vx2nt" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557") : secret "image-registry-tls" not found
Sep 06 12:18:15.651692 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:15.651654    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5tlns" event={"ID":"f36004a4-1edb-4a53-b195-19e6823b1cde","Type":"ContainerStarted","Data":"e96fb8f9c676901fd81af80f75c5807947a92c7fc17cee376740047c6d0eabb0"}
Sep 06 12:18:15.654935 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:15.654834    2568 generic.go:356] "Generic (PLEG): container finished" podID="2564df60-c9eb-4e85-82df-d44f54880bbb" containerID="a8109d2890d6beb91c9956b110a450cce62e425d623909ec6582f0d82fa16039" exitCode=0
Sep 06 12:18:15.654935 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:15.654884    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerDied","Data":"a8109d2890d6beb91c9956b110a450cce62e425d623909ec6582f0d82fa16039"}
Sep 06 12:18:16.018219 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:16.018189    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:16.075394 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:16.075353    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:16.127399 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:16.127365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:16.127551 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:16.127409    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:16.127551 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:16.127510    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:16.127551 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:16.127525    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:16.127551 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:16.127543    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbb69666-vx2nt: secret "image-registry-tls" not found
Sep 06 12:18:16.127785 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:16.127594    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls podName:0db9dffc-e714-49ad-b065-f3d1ce3a3562 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:18.127550543 +0000 UTC m=+38.101597708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls") pod "dns-default-rv585" (UID: "0db9dffc-e714-49ad-b065-f3d1ce3a3562") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:16.127785 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:16.127628    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls podName:4a5eb2a6-479d-4724-b6ac-b6ad73012557 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:18.127617521 +0000 UTC m=+38.101664688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls") pod "image-registry-5bbb69666-vx2nt" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557") : secret "image-registry-tls" not found
Sep 06 12:18:16.661201 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:16.661162    2568 generic.go:356] "Generic (PLEG): container finished" podID="2564df60-c9eb-4e85-82df-d44f54880bbb" containerID="57519d2c180f8f9728dce93d5d78f98c0683760ef56e427498a5e7afa64bca0e" exitCode=0
Sep 06 12:18:16.661356 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:16.661212    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerDied","Data":"57519d2c180f8f9728dce93d5d78f98c0683760ef56e427498a5e7afa64bca0e"}
Sep 06 12:18:17.667710 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:17.667676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" event={"ID":"2564df60-c9eb-4e85-82df-d44f54880bbb","Type":"ContainerStarted","Data":"64399c9ee1ecf9674234bd5cad3ea898157d493749274fa8457c62c58155e812"}
Sep 06 12:18:17.669171 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:17.669149    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5tlns" event={"ID":"f36004a4-1edb-4a53-b195-19e6823b1cde","Type":"ContainerStarted","Data":"766b4f22b25d3cc9535e4e7498ba624ff1525286ace7f6709689cc6428c5bea2"}
Sep 06 12:18:17.689167 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:17.689120    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rcvxx" podStartSLOduration=9.975552448 podStartE2EDuration="37.689105704s" totalImagesPullingTime="27.713553256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:17.688050577 +0000 UTC m=+37.662097762" watchObservedRunningTime="2026-09-06 12:18:17.689105704 +0000 UTC m=+37.663152889"
Sep 06 12:18:17.703609 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:17.703562    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5tlns" podStartSLOduration=1.3085417019999999 podStartE2EDuration="3.703545327s" totalImagesPullingTime="2.395003625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:17.702936387 +0000 UTC m=+37.676983571" watchObservedRunningTime="2026-09-06 12:18:17.703545327 +0000 UTC m=+37.677592514"
Sep 06 12:18:17.822441 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:17.822378    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:17.870031 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:17.870001    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:17.945335 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:17.945311    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:18.046605 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:18.046434    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:18.145074 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:18.145024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:18.145074 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:18.145052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:18.145199 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:18.145126    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:18.145199 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:18.145153    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:18.145199 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:18.145166    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbb69666-vx2nt: secret "image-registry-tls" not found
Sep 06 12:18:18.145199 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:18.145170    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls podName:0db9dffc-e714-49ad-b065-f3d1ce3a3562 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:22.145158977 +0000 UTC m=+42.119206154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls") pod "dns-default-rv585" (UID: "0db9dffc-e714-49ad-b065-f3d1ce3a3562") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:18.145339 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:18.145208    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls podName:4a5eb2a6-479d-4724-b6ac-b6ad73012557 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:22.145195038 +0000 UTC m=+42.119242217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls") pod "image-registry-5bbb69666-vx2nt" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557") : secret "image-registry-tls" not found
Sep 06 12:18:19.675072 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:19.675040    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:19.728426 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:19.728395    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:22.024752 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:22.024721    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:22.125123 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:22.125096    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:22.171008 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:22.170984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:22.171087 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:22.171026    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:22.171135 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:22.171112    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:22.171135 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:22.171117    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:22.171135 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:22.171130    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbb69666-vx2nt: secret "image-registry-tls" not found
Sep 06 12:18:22.171240 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:22.171160    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls podName:0db9dffc-e714-49ad-b065-f3d1ce3a3562 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:30.171146078 +0000 UTC m=+50.145193241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls") pod "dns-default-rv585" (UID: "0db9dffc-e714-49ad-b065-f3d1ce3a3562") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:22.171240 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:22.171199    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls podName:4a5eb2a6-479d-4724-b6ac-b6ad73012557 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:30.171192727 +0000 UTC m=+50.145239890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls") pod "image-registry-5bbb69666-vx2nt" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557") : secret "image-registry-tls" not found
Sep 06 12:18:22.987449 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:22.987405    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:23.057789 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.057762    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b"]
Sep 06 12:18:23.061874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.061846    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:23.088075 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.088055    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b"]
Sep 06 12:18:23.088178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.088160    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b"
Sep 06 12:18:23.090286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.090265    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k7vx8\""
Sep 06 12:18:23.090434 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.090420    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 06 12:18:23.090851 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.090833    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 06 12:18:23.119105 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.119084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:23.278563 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.278515    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xrh\" (UniqueName: \"kubernetes.io/projected/f965a923-198f-4b53-a556-7910ccf00127-kube-api-access-92xrh\") pod \"migrator-fdbb8fdff-q6h7b\" (UID: \"f965a923-198f-4b53-a556-7910ccf00127\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b"
Sep 06 12:18:23.378939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.378899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xrh\" (UniqueName: \"kubernetes.io/projected/f965a923-198f-4b53-a556-7910ccf00127-kube-api-access-92xrh\") pod \"migrator-fdbb8fdff-q6h7b\" (UID: \"f965a923-198f-4b53-a556-7910ccf00127\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b"
Sep 06 12:18:23.394883 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.394859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:23.395809 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.395791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xrh\" (UniqueName: \"kubernetes.io/projected/f965a923-198f-4b53-a556-7910ccf00127-kube-api-access-92xrh\") pod \"migrator-fdbb8fdff-q6h7b\" (UID: \"f965a923-198f-4b53-a556-7910ccf00127\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b"
Sep 06 12:18:23.396578 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.396564    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b"
Sep 06 12:18:23.402632 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.402615    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8h2nz"]
Sep 06 12:18:23.419245 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.419226    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8h2nz"]
Sep 06 12:18:23.419346 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.419325    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.421227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.421147    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 12:18:23.421227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.421210    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 12:18:23.421542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.421525    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 12:18:23.421736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.421721    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 12:18:23.421975 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.421951    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-spt24\""
Sep 06 12:18:23.453163 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.453135    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:23.581041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.580963    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/751d3825-8cdf-495d-817e-646d55879669-data-volume\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.581041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.580994    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.581041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.581030    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/751d3825-8cdf-495d-817e-646d55879669-crio-socket\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.581230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.581125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbbdf\" (UniqueName: \"kubernetes.io/projected/751d3825-8cdf-495d-817e-646d55879669-kube-api-access-fbbdf\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.581230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.581154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.681493 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.681471    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/751d3825-8cdf-495d-817e-646d55879669-crio-socket\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.681592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.681525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbbdf\" (UniqueName: \"kubernetes.io/projected/751d3825-8cdf-495d-817e-646d55879669-kube-api-access-fbbdf\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.681592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.681546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.681592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.681577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/751d3825-8cdf-495d-817e-646d55879669-data-volume\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.681592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.681591    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.681748 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.681660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/751d3825-8cdf-495d-817e-646d55879669-crio-socket\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.681748 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:23.681704    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:23.681748 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:23.681705    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 12:18:23.681834 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:23.681767    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:24.181747873 +0000 UTC m=+44.155795035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:23.681834 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:23.681786    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:24.181777167 +0000 UTC m=+44.155824331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : configmap "kube-rbac-proxy" not found
Sep 06 12:18:23.681903 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.681889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/751d3825-8cdf-495d-817e-646d55879669-data-volume\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.685708 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.685686    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b"]
Sep 06 12:18:23.689004 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:23.688980    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf965a923_198f_4b53_a556_7910ccf00127.slice/crio-1a2885529d0465d43f8b9da7993f94985bff3f2f0353f3cdecede59c03e7200b WatchSource:0}: Error finding container 1a2885529d0465d43f8b9da7993f94985bff3f2f0353f3cdecede59c03e7200b: Status 404 returned error can't find the container with id 1a2885529d0465d43f8b9da7993f94985bff3f2f0353f3cdecede59c03e7200b
Sep 06 12:18:23.692723 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.692705    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbbdf\" (UniqueName: \"kubernetes.io/projected/751d3825-8cdf-495d-817e-646d55879669-kube-api-access-fbbdf\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:23.694709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.694683    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:23.794471 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:23.794446    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:24.185126 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:24.185105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:24.185447 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:24.185142    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:24.185447 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:24.185210    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 12:18:24.185447 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:24.185241    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:24.185447 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:24.185253    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:25.185241319 +0000 UTC m=+45.159288482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : configmap "kube-rbac-proxy" not found
Sep 06 12:18:24.185447 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:24.185286    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:25.185272813 +0000 UTC m=+45.159319976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:24.684650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:24.684619    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b" event={"ID":"f965a923-198f-4b53-a556-7910ccf00127","Type":"ContainerStarted","Data":"1a2885529d0465d43f8b9da7993f94985bff3f2f0353f3cdecede59c03e7200b"}
Sep 06 12:18:25.192624 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.192569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:25.193001 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.192643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:25.193001 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:25.192706    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:25.193001 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:25.192713    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 12:18:25.193001 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:25.192766    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:27.192752554 +0000 UTC m=+47.166799717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : configmap "kube-rbac-proxy" not found
Sep 06 12:18:25.193001 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:25.192779    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:27.192773571 +0000 UTC m=+47.166820734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:25.295354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.295324    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-lp877"]
Sep 06 12:18:25.308103 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.308077    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-lp877"]
Sep 06 12:18:25.308189 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.308177    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.310187 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.310167    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 06 12:18:25.310854 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.310830    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 06 12:18:25.310967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.310877    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 06 12:18:25.310967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.310881    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lfqqg\""
Sep 06 12:18:25.311070 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.310835    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 06 12:18:25.322973 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.322954    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:25.369760 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.369714    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:25.495002 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.494944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvpgd\" (UniqueName: \"kubernetes.io/projected/2ce06aff-12b0-4825-b32e-56fb77417cde-kube-api-access-bvpgd\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.495002 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.494981    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ce06aff-12b0-4825-b32e-56fb77417cde-signing-key\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.495110 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.495060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ce06aff-12b0-4825-b32e-56fb77417cde-signing-cabundle\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.554355 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.554337    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59v9r_e32fc3b0-b1a7-4e08-83e7-3779065e0a6e/dns-node-resolver/0.log"
Sep 06 12:18:25.596017 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.595998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvpgd\" (UniqueName: \"kubernetes.io/projected/2ce06aff-12b0-4825-b32e-56fb77417cde-kube-api-access-bvpgd\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.596099 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.596028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ce06aff-12b0-4825-b32e-56fb77417cde-signing-key\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.596099 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.596080    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ce06aff-12b0-4825-b32e-56fb77417cde-signing-cabundle\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.599754 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.597088    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ce06aff-12b0-4825-b32e-56fb77417cde-signing-cabundle\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.600524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.600504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ce06aff-12b0-4825-b32e-56fb77417cde-signing-key\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.603529 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.603507    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvpgd\" (UniqueName: \"kubernetes.io/projected/2ce06aff-12b0-4825-b32e-56fb77417cde-kube-api-access-bvpgd\") pod \"service-ca-75d99c484-lp877\" (UID: \"2ce06aff-12b0-4825-b32e-56fb77417cde\") " pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.617316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.617300    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-lp877"
Sep 06 12:18:25.690274 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.690238    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b" event={"ID":"f965a923-198f-4b53-a556-7910ccf00127","Type":"ContainerStarted","Data":"62301f2f26310919c31cb7320b0cebe1650dfa02321f757ce15e75483c88cda7"}
Sep 06 12:18:25.846900 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.846869    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:25.917792 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.917769    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-lp877"]
Sep 06 12:18:25.921313 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:25.921294    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce06aff_12b0_4825_b32e_56fb77417cde.slice/crio-33fb558dab44d13490c482de5219457eadd1b19d350bb14c0dda38b7c6f3206b WatchSource:0}: Error finding container 33fb558dab44d13490c482de5219457eadd1b19d350bb14c0dda38b7c6f3206b: Status 404 returned error can't find the container with id 33fb558dab44d13490c482de5219457eadd1b19d350bb14c0dda38b7c6f3206b
Sep 06 12:18:25.941368 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:25.941345    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:26.208447 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:26.208426    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:26.554448 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:26.554385    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lfrbv_13171d83-fc1e-4f9b-b75a-edadb8cff3da/node-ca/0.log"
Sep 06 12:18:26.694764 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:26.694730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b" event={"ID":"f965a923-198f-4b53-a556-7910ccf00127","Type":"ContainerStarted","Data":"9491a2ed86211d55a286069fc1030b0f1bf16eac0cb9f41aebc4aab0c1172afb"}
Sep 06 12:18:26.696174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:26.696143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-lp877" event={"ID":"2ce06aff-12b0-4825-b32e-56fb77417cde","Type":"ContainerStarted","Data":"33fb558dab44d13490c482de5219457eadd1b19d350bb14c0dda38b7c6f3206b"}
Sep 06 12:18:26.710700 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:26.710662    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q6h7b" podStartSLOduration=1.875535457 podStartE2EDuration="3.710648645s" totalImagesPullingTime="1.835113188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:26.70947657 +0000 UTC m=+46.683523746" watchObservedRunningTime="2026-09-06 12:18:26.710648645 +0000 UTC m=+46.684695831"
Sep 06 12:18:26.865159 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:26.865083    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:26.921060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:26.921030    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:27.209736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:27.209707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:27.210140 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:27.209788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:27.210140 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:27.209800    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 12:18:27.210140 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:27.209859    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:31.209844767 +0000 UTC m=+51.183891952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : configmap "kube-rbac-proxy" not found
Sep 06 12:18:27.210140 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:27.209873    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:27.210140 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:27.209912    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:31.209900807 +0000 UTC m=+51.183947970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:27.355031 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:27.354995    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5tlns_f36004a4-1edb-4a53-b195-19e6823b1cde/serve-healthcheck-canary/0.log"
Sep 06 12:18:27.754769 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:27.754741    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-q6h7b_f965a923-198f-4b53-a556-7910ccf00127/migrator/0.log"
Sep 06 12:18:27.954012 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:27.953986    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-q6h7b_f965a923-198f-4b53-a556-7910ccf00127/graceful-termination/0.log"
Sep 06 12:18:28.656327 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:28.656297    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:28.703347 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:28.703322    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-lp877" event={"ID":"2ce06aff-12b0-4825-b32e-56fb77417cde","Type":"ContainerStarted","Data":"3e96452b751238f7fe68a1bc06b5b5eac761da9c876152e1f56ded4d768cfa65"}
Sep 06 12:18:28.720269 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:28.720224    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-lp877" podStartSLOduration=1.4706343689999999 podStartE2EDuration="3.720209261s" totalImagesPullingTime="2.249574892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:28.719656166 +0000 UTC m=+48.693703351" watchObservedRunningTime="2026-09-06 12:18:28.720209261 +0000 UTC m=+48.694256482"
Sep 06 12:18:29.480300 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:29.480271    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:29.833150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:29.833046    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:30.001159 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:30.001103    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:30.101766 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:30.101693    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:30.201483 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:30.201451    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:30.235621 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:30.235575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:30.235771 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:30.235639    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:30.235831 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:30.235771    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:30.235882 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:30.235833    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls podName:0db9dffc-e714-49ad-b065-f3d1ce3a3562 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:46.235817014 +0000 UTC m=+66.209864192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls") pod "dns-default-rv585" (UID: "0db9dffc-e714-49ad-b065-f3d1ce3a3562") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:30.235943 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:30.235900    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:30.235943 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:30.235911    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbb69666-vx2nt: secret "image-registry-tls" not found
Sep 06 12:18:30.235943 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:30.235943    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls podName:4a5eb2a6-479d-4724-b6ac-b6ad73012557 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:46.2359321 +0000 UTC m=+66.209979266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls") pod "image-registry-5bbb69666-vx2nt" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557") : secret "image-registry-tls" not found
Sep 06 12:18:30.310822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:30.310795    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:30.531721 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:30.531692    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:31.243682 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:31.243647    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:31.244123 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:31.243710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:31.244123 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:31.243803    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:31.244123 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:31.243881    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls podName:751d3825-8cdf-495d-817e-646d55879669 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:39.24385943 +0000 UTC m=+59.217906613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8h2nz" (UID: "751d3825-8cdf-495d-817e-646d55879669") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:31.244310 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:31.244291    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/751d3825-8cdf-495d-817e-646d55879669-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:31.529225 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:31.529163    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:31.930361 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:31.930283    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:32.130822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:32.130794    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:32.333067 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:32.333031    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:32.530022 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:32.529998    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:33.019838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:33.019796    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:33.436060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:33.435999    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:33.536818 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:33.536791    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:33.637358 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:33.637326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:33.928460 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:33.928430    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:34.134214 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:34.134156    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:34.234548 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:34.234522    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:34.334806 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:34.334782    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:34.434659 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:34.434638    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:34.534888 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:34.534806    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:34.696682 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:34.696660    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:34.795936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:34.795859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.156739 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.156666    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.251186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.251161    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.351130 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.351106    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.451316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.451292    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.554763 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.554737    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.657565 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.657542    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.758694 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.758593    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.859023 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.858996    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:35.960570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:35.960546    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:36.061570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:36.061492    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:36.328268 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:36.328174    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:36.926752 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:36.926723    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:37.519961 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:37.519932    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:37.620952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:37.620930    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:37.732819 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:37.732784    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:37.928756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:37.928677    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:38.332546 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:38.332515    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:38.932164 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:38.932136    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:39.306727 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.306696    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:39.308966 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.308934    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/751d3825-8cdf-495d-817e-646d55879669-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8h2nz\" (UID: \"751d3825-8cdf-495d-817e-646d55879669\") " pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:39.333057 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.333037    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8h2nz"
Sep 06 12:18:39.526037 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.526001    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:39.598574 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.598520    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8h2nz"]
Sep 06 12:18:39.601562 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:39.601539    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751d3825_8cdf_495d_817e_646d55879669.slice/crio-e8bb90bf94b2ca0a3c17e27b7f6aeb52732fc54c208fc851760a79c37e85b356 WatchSource:0}: Error finding container e8bb90bf94b2ca0a3c17e27b7f6aeb52732fc54c208fc851760a79c37e85b356: Status 404 returned error can't find the container with id e8bb90bf94b2ca0a3c17e27b7f6aeb52732fc54c208fc851760a79c37e85b356
Sep 06 12:18:39.663480 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.663457    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntbvk"
Sep 06 12:18:39.728002 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.727966    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:39.730626 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.730586    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8h2nz" event={"ID":"751d3825-8cdf-495d-817e-646d55879669","Type":"ContainerStarted","Data":"1a875e92a5c122696c8dfcbcbc598257b387cdccee41cd301e0d9b859e107042"}
Sep 06 12:18:39.730724 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.730647    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8h2nz" event={"ID":"751d3825-8cdf-495d-817e-646d55879669","Type":"ContainerStarted","Data":"e8bb90bf94b2ca0a3c17e27b7f6aeb52732fc54c208fc851760a79c37e85b356"}
Sep 06 12:18:39.924041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:39.923981    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:40.126881 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:40.126859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:40.732538 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:40.732510    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:40.735328 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:40.735306    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8h2nz" event={"ID":"751d3825-8cdf-495d-817e-646d55879669","Type":"ContainerStarted","Data":"e1ca49f242375f29e96b32582e7517122d9327d19f833f0b24a27f6548d6dd43"}
Sep 06 12:18:40.927854 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:40.927807    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:41.834876 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:41.834851    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:41.934927 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:41.934893    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:42.743322 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:42.743292    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8h2nz" event={"ID":"751d3825-8cdf-495d-817e-646d55879669","Type":"ContainerStarted","Data":"a108adca958f24c9820ca490ad84c781fc1e3888cc3ecf698cfebddf0abb90a8"}
Sep 06 12:18:42.758215 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:42.758175    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8h2nz" podStartSLOduration=17.673151196 podStartE2EDuration="19.758163223s" totalImagesPullingTime="2.085012027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:18:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:42.757474503 +0000 UTC m=+62.731521687" watchObservedRunningTime="2026-09-06 12:18:42.758163223 +0000 UTC m=+62.732210407"
Sep 06 12:18:43.926820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:43.926788    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:44.851633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:44.851582    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:44.900349 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:44.900324    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:45.419476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.419454    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"]
Sep 06 12:18:45.454153 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.454134    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"]
Sep 06 12:18:45.454266 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.454250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"
Sep 06 12:18:45.456106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.456085    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 06 12:18:45.456189 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.456153    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 06 12:18:45.456289 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.456251    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 06 12:18:45.456757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.456743    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-w6x48\""
Sep 06 12:18:45.469274 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.469250    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 06 12:18:45.469693 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.469679    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"]
Sep 06 12:18:45.469772 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.469701    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"]
Sep 06 12:18:45.469772 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.469715    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bbb69666-vx2nt"]
Sep 06 12:18:45.469885 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.469818    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.469938 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:18:45.469820    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5bbb69666-vx2nt" podUID="4a5eb2a6-479d-4724-b6ac-b6ad73012557"
Sep 06 12:18:45.471474 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.471454    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 06 12:18:45.471526 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.471470    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 06 12:18:45.471575 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.471552    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 06 12:18:45.471755 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.471742    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 06 12:18:45.497900 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.497855    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:45.518476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.518453    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69b86fc7f4-gd8gc"]
Sep 06 12:18:45.533368 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.533348    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.534632 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.534589    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69b86fc7f4-gd8gc"]
Sep 06 12:18:45.552045 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.552028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkf7d\" (UniqueName: \"kubernetes.io/projected/d30c702f-7c99-474f-ad36-6673b559fcf7-kube-api-access-lkf7d\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.552126 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.552064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6a87451-d7b0-4573-a154-1997c831d276-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-567bc5b6d4-g75kl\" (UID: \"b6a87451-d7b0-4573-a154-1997c831d276\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"
Sep 06 12:18:45.552126 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.552095    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.552126 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.552119    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-ca\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.552227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.552148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdr2q\" (UniqueName: \"kubernetes.io/projected/b6a87451-d7b0-4573-a154-1997c831d276-kube-api-access-xdr2q\") pod \"managed-serviceaccount-addon-agent-567bc5b6d4-g75kl\" (UID: \"b6a87451-d7b0-4573-a154-1997c831d276\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"
Sep 06 12:18:45.552227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.552167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.552227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.552183    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-hub\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.552313 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.552265    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30c702f-7c99-474f-ad36-6673b559fcf7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.572395 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.572374    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:45.653345 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6a87451-d7b0-4573-a154-1997c831d276-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-567bc5b6d4-g75kl\" (UID: \"b6a87451-d7b0-4573-a154-1997c831d276\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"
Sep 06 12:18:45.653451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653365    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-registry-tls\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.653451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653397    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26f41fbe-9998-4fa2-8346-3c355e8befae-installation-pull-secrets\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.653451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26f41fbe-9998-4fa2-8346-3c355e8befae-registry-certificates\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.653640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.653640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653513    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvpd\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-kube-api-access-ckvpd\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.653640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-ca\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.653640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdr2q\" (UniqueName: \"kubernetes.io/projected/b6a87451-d7b0-4573-a154-1997c831d276-kube-api-access-xdr2q\") pod \"managed-serviceaccount-addon-agent-567bc5b6d4-g75kl\" (UID: \"b6a87451-d7b0-4573-a154-1997c831d276\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"
Sep 06 12:18:45.653825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-bound-sa-token\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.653825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.653825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653693    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-hub\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.653825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26f41fbe-9998-4fa2-8346-3c355e8befae-image-registry-private-configuration\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.653825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653764    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30c702f-7c99-474f-ad36-6673b559fcf7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.653825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26f41fbe-9998-4fa2-8346-3c355e8befae-ca-trust-extracted\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.654117 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653832    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26f41fbe-9998-4fa2-8346-3c355e8befae-trusted-ca\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.654117 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.653856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkf7d\" (UniqueName: \"kubernetes.io/projected/d30c702f-7c99-474f-ad36-6673b559fcf7-kube-api-access-lkf7d\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.654862 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.654838    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30c702f-7c99-474f-ad36-6673b559fcf7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.656110 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.656090    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-ca\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.656270 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.656235    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6a87451-d7b0-4573-a154-1997c831d276-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-567bc5b6d4-g75kl\" (UID: \"b6a87451-d7b0-4573-a154-1997c831d276\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"
Sep 06 12:18:45.656402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.656387    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.656726 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.656707    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-hub\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.656864 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.656848    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d30c702f-7c99-474f-ad36-6673b559fcf7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.661878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.661851    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkf7d\" (UniqueName: \"kubernetes.io/projected/d30c702f-7c99-474f-ad36-6673b559fcf7-kube-api-access-lkf7d\") pod \"cluster-proxy-proxy-agent-79bf4f47db-hbncr\" (UID: \"d30c702f-7c99-474f-ad36-6673b559fcf7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.662085 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.662070    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdr2q\" (UniqueName: \"kubernetes.io/projected/b6a87451-d7b0-4573-a154-1997c831d276-kube-api-access-xdr2q\") pod \"managed-serviceaccount-addon-agent-567bc5b6d4-g75kl\" (UID: \"b6a87451-d7b0-4573-a154-1997c831d276\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"
Sep 06 12:18:45.668583 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.668560    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:45.751452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.751432    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:45.754530 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.754493    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-registry-tls\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.754668 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.754567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26f41fbe-9998-4fa2-8346-3c355e8befae-installation-pull-secrets\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.754922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.754904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26f41fbe-9998-4fa2-8346-3c355e8befae-registry-certificates\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.755147 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.755127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvpd\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-kube-api-access-ckvpd\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.755970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.755946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-bound-sa-token\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.756064 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.756019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26f41fbe-9998-4fa2-8346-3c355e8befae-image-registry-private-configuration\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.756131 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.756071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26f41fbe-9998-4fa2-8346-3c355e8befae-ca-trust-extracted\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.756188 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.756131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26f41fbe-9998-4fa2-8346-3c355e8befae-trusted-ca\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.757116 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.756812    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26f41fbe-9998-4fa2-8346-3c355e8befae-registry-certificates\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.757246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.757221    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26f41fbe-9998-4fa2-8346-3c355e8befae-ca-trust-extracted\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.759838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.759812    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26f41fbe-9998-4fa2-8346-3c355e8befae-trusted-ca\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.760391 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.760367    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26f41fbe-9998-4fa2-8346-3c355e8befae-image-registry-private-configuration\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.760584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.760568    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26f41fbe-9998-4fa2-8346-3c355e8befae-installation-pull-secrets\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.761162 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.761143    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-registry-tls\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.767649 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.767627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvpd\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-kube-api-access-ckvpd\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.767815 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.767794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26f41fbe-9998-4fa2-8346-3c355e8befae-bound-sa-token\") pod \"image-registry-69b86fc7f4-gd8gc\" (UID: \"26f41fbe-9998-4fa2-8346-3c355e8befae\") " pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.768414 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.768351    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:45.774243 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.774221    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"
Sep 06 12:18:45.780374 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.780357    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"
Sep 06 12:18:45.793815 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.793802    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:45.854685 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.854659    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jx6gc\""
Sep 06 12:18:45.857176 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857155    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-image-registry-private-configuration\") pod \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") "
Sep 06 12:18:45.857357 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857186    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-trusted-ca\") pod \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") "
Sep 06 12:18:45.857357 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857244    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-certificates\") pod \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") "
Sep 06 12:18:45.857493 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857473    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6c9q\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-kube-api-access-p6c9q\") pod \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") "
Sep 06 12:18:45.857568 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857511    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4a5eb2a6-479d-4724-b6ac-b6ad73012557" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:18:45.857568 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857515    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-installation-pull-secrets\") pod \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") "
Sep 06 12:18:45.857710 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857566    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a5eb2a6-479d-4724-b6ac-b6ad73012557-ca-trust-extracted\") pod \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") "
Sep 06 12:18:45.857710 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857620    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-bound-sa-token\") pod \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") "
Sep 06 12:18:45.857884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857831    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a5eb2a6-479d-4724-b6ac-b6ad73012557-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4a5eb2a6-479d-4724-b6ac-b6ad73012557" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:18:45.858001 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.857981    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-certificates\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:18:45.858076 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.858007    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a5eb2a6-479d-4724-b6ac-b6ad73012557-ca-trust-extracted\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:18:45.858076 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.858029    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4a5eb2a6-479d-4724-b6ac-b6ad73012557" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:18:45.860866 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.860821    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4a5eb2a6-479d-4724-b6ac-b6ad73012557" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:18:45.862005 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.861056    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4a5eb2a6-479d-4724-b6ac-b6ad73012557" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:18:45.862005 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.861188    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4a5eb2a6-479d-4724-b6ac-b6ad73012557" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:18:45.862005 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.861534    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-kube-api-access-p6c9q" (OuterVolumeSpecName: "kube-api-access-p6c9q") pod "4a5eb2a6-479d-4724-b6ac-b6ad73012557" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557"). InnerVolumeSpecName "kube-api-access-p6c9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:18:45.863948 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.863896    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:45.870175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.870025    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:45.959273 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.959249    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6c9q\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-kube-api-access-p6c9q\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:18:45.959373 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.959276    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-installation-pull-secrets\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:18:45.959373 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.959289    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-bound-sa-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:18:45.959373 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.959302    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a5eb2a6-479d-4724-b6ac-b6ad73012557-image-registry-private-configuration\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:18:45.959373 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:45.959314    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a5eb2a6-479d-4724-b6ac-b6ad73012557-trusted-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:18:46.083553 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.083460    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl"]
Sep 06 12:18:46.085958 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:46.085935    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6a87451_d7b0_4573_a154_1997c831d276.slice/crio-3f60b032120edff191b4060c6e300ac86f56023753e92198c1bd5c79459a9c63 WatchSource:0}: Error finding container 3f60b032120edff191b4060c6e300ac86f56023753e92198c1bd5c79459a9c63: Status 404 returned error can't find the container with id 3f60b032120edff191b4060c6e300ac86f56023753e92198c1bd5c79459a9c63
Sep 06 12:18:46.089361 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.089339    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr"]
Sep 06 12:18:46.091852 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:46.091832    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd30c702f_7c99_474f_ad36_6673b559fcf7.slice/crio-a670835c4fb75a9c5fca32cd916ac17aca3321ea1dcab26c83370859360509ca WatchSource:0}: Error finding container a670835c4fb75a9c5fca32cd916ac17aca3321ea1dcab26c83370859360509ca: Status 404 returned error can't find the container with id a670835c4fb75a9c5fca32cd916ac17aca3321ea1dcab26c83370859360509ca
Sep 06 12:18:46.138364 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.138342    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69b86fc7f4-gd8gc"]
Sep 06 12:18:46.140349 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:46.140330    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f41fbe_9998_4fa2_8346_3c355e8befae.slice/crio-7fa8bfe225f285c7f07d7ee0e08f7f979122bebb41b0a781eb581bf3f9e65831 WatchSource:0}: Error finding container 7fa8bfe225f285c7f07d7ee0e08f7f979122bebb41b0a781eb581bf3f9e65831: Status 404 returned error can't find the container with id 7fa8bfe225f285c7f07d7ee0e08f7f979122bebb41b0a781eb581bf3f9e65831
Sep 06 12:18:46.260592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.260563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:46.260695 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.260651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:46.260695 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.260674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:46.262356 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.262339    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 12:18:46.262970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.262951    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db9dffc-e714-49ad-b065-f3d1ce3a3562-metrics-tls\") pod \"dns-default-rv585\" (UID: \"0db9dffc-e714-49ad-b065-f3d1ce3a3562\") " pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:46.263082 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.263065    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"image-registry-5bbb69666-vx2nt\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") " pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:46.273004 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.272978    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfe89a28-bbb4-475f-8219-d93d063bc226-original-pull-secret\") pod \"global-pull-secret-syncer-g6tjq\" (UID: \"bfe89a28-bbb4-475f-8219-d93d063bc226\") " pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:46.332705 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.332675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6tjq"
Sep 06 12:18:46.362028 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.361998    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") pod \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\" (UID: \"4a5eb2a6-479d-4724-b6ac-b6ad73012557\") "
Sep 06 12:18:46.362208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.362189    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:46.364100 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.364073    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 12:18:46.364210 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.364165    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4a5eb2a6-479d-4724-b6ac-b6ad73012557" (UID: "4a5eb2a6-479d-4724-b6ac-b6ad73012557"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:18:46.375258 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.375234    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e72a897-0d80-4d6c-bf8b-ad1287fe621e-metrics-certs\") pod \"network-metrics-daemon-dzk4s\" (UID: \"8e72a897-0d80-4d6c-bf8b-ad1287fe621e\") " pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:46.462549 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.462516    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:46.462869 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.462559    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a5eb2a6-479d-4724-b6ac-b6ad73012557-registry-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:18:46.464467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.464450    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 12:18:46.474845 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.474827    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 12:18:46.485867 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.485847    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqghd\" (UniqueName: \"kubernetes.io/projected/cdd6f0e5-b216-42e2-983e-f9109aff23a7-kube-api-access-hqghd\") pod \"network-check-target-wfbzs\" (UID: \"cdd6f0e5-b216-42e2-983e-f9109aff23a7\") " pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:46.523259 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.523243    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2nk9\""
Sep 06 12:18:46.531764 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.531709    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:46.604989 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.604934    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g6tjq"]
Sep 06 12:18:46.607980 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:46.607945    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe89a28_bbb4_475f_8219_d93d063bc226.slice/crio-a34eab5ebcfc496601c849ca69504c7b055b63cadbd7719d16cffbd8e827e9d1 WatchSource:0}: Error finding container a34eab5ebcfc496601c849ca69504c7b055b63cadbd7719d16cffbd8e827e9d1: Status 404 returned error can't find the container with id a34eab5ebcfc496601c849ca69504c7b055b63cadbd7719d16cffbd8e827e9d1
Sep 06 12:18:46.621443 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.621411    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrr2p\""
Sep 06 12:18:46.628442 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.628427    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vrsdl\""
Sep 06 12:18:46.630763 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.630749    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzk4s"
Sep 06 12:18:46.637879 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.637863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:46.755858 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.755832    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g6tjq" event={"ID":"bfe89a28-bbb4-475f-8219-d93d063bc226","Type":"ContainerStarted","Data":"a34eab5ebcfc496601c849ca69504c7b055b63cadbd7719d16cffbd8e827e9d1"}
Sep 06 12:18:46.756907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.756887    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr" event={"ID":"d30c702f-7c99-474f-ad36-6673b559fcf7","Type":"ContainerStarted","Data":"a670835c4fb75a9c5fca32cd916ac17aca3321ea1dcab26c83370859360509ca"}
Sep 06 12:18:46.757903 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.757882    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl" event={"ID":"b6a87451-d7b0-4573-a154-1997c831d276","Type":"ContainerStarted","Data":"3f60b032120edff191b4060c6e300ac86f56023753e92198c1bd5c79459a9c63"}
Sep 06 12:18:46.759233 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.759207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc" event={"ID":"26f41fbe-9998-4fa2-8346-3c355e8befae","Type":"ContainerStarted","Data":"c9493183209a363766da35acd53113f2790fc7eecd010b99073ca5fd31a1fc81"}
Sep 06 12:18:46.759300 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.759256    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc" event={"ID":"26f41fbe-9998-4fa2-8346-3c355e8befae","Type":"ContainerStarted","Data":"7fa8bfe225f285c7f07d7ee0e08f7f979122bebb41b0a781eb581bf3f9e65831"}
Sep 06 12:18:46.759300 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.759222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbb69666-vx2nt"
Sep 06 12:18:46.759454 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.759436    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:18:46.777132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.777076    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc" podStartSLOduration=1.777063448 podStartE2EDuration="1.777063448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:46.776716001 +0000 UTC m=+66.750763185" watchObservedRunningTime="2026-09-06 12:18:46.777063448 +0000 UTC m=+66.751110632"
Sep 06 12:18:46.799820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.799799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rv585"]
Sep 06 12:18:46.803247 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:46.803223    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db9dffc_e714_49ad_b065_f3d1ce3a3562.slice/crio-6f033f304da1a6108ba556c810eb1418abf01a31a0007f802cbff86e8e93647a WatchSource:0}: Error finding container 6f033f304da1a6108ba556c810eb1418abf01a31a0007f802cbff86e8e93647a: Status 404 returned error can't find the container with id 6f033f304da1a6108ba556c810eb1418abf01a31a0007f802cbff86e8e93647a
Sep 06 12:18:46.803847 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.803831    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bbb69666-vx2nt"]
Sep 06 12:18:46.809806 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.809785    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bbb69666-vx2nt"]
Sep 06 12:18:46.904257 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.904229    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dzk4s"]
Sep 06 12:18:46.907898 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:46.907870    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e72a897_0d80_4d6c_bf8b_ad1287fe621e.slice/crio-020c580491836c46b0ead5f8e6be95dbd655691dc15cab5ded063f426e0d7108 WatchSource:0}: Error finding container 020c580491836c46b0ead5f8e6be95dbd655691dc15cab5ded063f426e0d7108: Status 404 returned error can't find the container with id 020c580491836c46b0ead5f8e6be95dbd655691dc15cab5ded063f426e0d7108
Sep 06 12:18:46.914184 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:46.914161    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfbzs"]
Sep 06 12:18:46.917670 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:18:46.917645    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd6f0e5_b216_42e2_983e_f9109aff23a7.slice/crio-c2f11c86e3fcfb1641cfe497e344f72f158fe68db0f921020b5c67c901a642cd WatchSource:0}: Error finding container c2f11c86e3fcfb1641cfe497e344f72f158fe68db0f921020b5c67c901a642cd: Status 404 returned error can't find the container with id c2f11c86e3fcfb1641cfe497e344f72f158fe68db0f921020b5c67c901a642cd
Sep 06 12:18:47.210675 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:47.210568    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:47.311037 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:47.310995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:47.768587 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:47.768449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzk4s" event={"ID":"8e72a897-0d80-4d6c-bf8b-ad1287fe621e","Type":"ContainerStarted","Data":"020c580491836c46b0ead5f8e6be95dbd655691dc15cab5ded063f426e0d7108"}
Sep 06 12:18:47.771749 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:47.771720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfbzs" event={"ID":"cdd6f0e5-b216-42e2-983e-f9109aff23a7","Type":"ContainerStarted","Data":"c2f11c86e3fcfb1641cfe497e344f72f158fe68db0f921020b5c67c901a642cd"}
Sep 06 12:18:47.775928 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:47.775901    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rv585" event={"ID":"0db9dffc-e714-49ad-b065-f3d1ce3a3562","Type":"ContainerStarted","Data":"6f033f304da1a6108ba556c810eb1418abf01a31a0007f802cbff86e8e93647a"}
Sep 06 12:18:48.515073 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:48.515035    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a5eb2a6-479d-4724-b6ac-b6ad73012557" path="/var/lib/kubelet/pods/4a5eb2a6-479d-4724-b6ac-b6ad73012557/volumes"
Sep 06 12:18:51.647157 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:51.647115    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:51.694247 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:51.694214    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:53.327138 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:53.327085    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:53.427792 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:53.427752    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:54.801487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.801439    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfbzs" event={"ID":"cdd6f0e5-b216-42e2-983e-f9109aff23a7","Type":"ContainerStarted","Data":"994f4f8a362d1c80a9fce7dafc79341e522977f616886a3a925c4836bfff80ba"}
Sep 06 12:18:54.801933 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.801546    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:18:54.803308 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.803283    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rv585" event={"ID":"0db9dffc-e714-49ad-b065-f3d1ce3a3562","Type":"ContainerStarted","Data":"54e906a9e66c14c3a2c710a06058029bce1cae856e48673ef8fc81342f383421"}
Sep 06 12:18:54.803420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.803322    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rv585" event={"ID":"0db9dffc-e714-49ad-b065-f3d1ce3a3562","Type":"ContainerStarted","Data":"435373241ba0dbd73436410f537e82f876909d51c245eceaee2d922abd09328c"}
Sep 06 12:18:54.803420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.803347    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rv585"
Sep 06 12:18:54.804788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.804765    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g6tjq" event={"ID":"bfe89a28-bbb4-475f-8219-d93d063bc226","Type":"ContainerStarted","Data":"e16122aaa96f719be591bf73e07ea37c64793a5128d0269574062f39e7e311f7"}
Sep 06 12:18:54.806889 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.806871    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr" event={"ID":"d30c702f-7c99-474f-ad36-6673b559fcf7","Type":"ContainerStarted","Data":"0bce981f1fad1ee1ff4bf05fab216c9b1d2c7bad171d266d387c60a692b49d1e"}
Sep 06 12:18:54.806974 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.806897    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr" event={"ID":"d30c702f-7c99-474f-ad36-6673b559fcf7","Type":"ContainerStarted","Data":"6b1e43882131bec3632080af489a754ec48cca215a6e4740a66e2b8bd2c3b532"}
Sep 06 12:18:54.806974 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.806910    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr" event={"ID":"d30c702f-7c99-474f-ad36-6673b559fcf7","Type":"ContainerStarted","Data":"6d85554870336e322331969621c5d6b5b7948be4562db31ed0420fe04f727a77"}
Sep 06 12:18:54.808374 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.808352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl" event={"ID":"b6a87451-d7b0-4573-a154-1997c831d276","Type":"ContainerStarted","Data":"1702b16989ceef419c20091008e995bed1b2e0f9e48756430d15df6ea0b67bf8"}
Sep 06 12:18:54.810106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.810086    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzk4s" event={"ID":"8e72a897-0d80-4d6c-bf8b-ad1287fe621e","Type":"ContainerStarted","Data":"abd9ccdd65167ebe1ad5675158e11a2099984300b834cb8816093d88f1f79029"}
Sep 06 12:18:54.810199 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.810121    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzk4s" event={"ID":"8e72a897-0d80-4d6c-bf8b-ad1287fe621e","Type":"ContainerStarted","Data":"02cfa19f2a45adb670e323f4c1ea7b430919cebc789f3c944240b0f5570438f2"}
Sep 06 12:18:54.814470 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.814424    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wfbzs" podStartSLOduration=67.517106216 podStartE2EDuration="1m14.81440856s" totalImagesPullingTime="7.297302344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:54.814286365 +0000 UTC m=+74.788333556" watchObservedRunningTime="2026-09-06 12:18:54.81440856 +0000 UTC m=+74.788455745"
Sep 06 12:18:54.829305 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.829258    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79bf4f47db-hbncr" podStartSLOduration=1.694038946 podStartE2EDuration="9.829242821s" totalImagesPullingTime="8.135203875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:54.828913052 +0000 UTC m=+74.802960250" watchObservedRunningTime="2026-09-06 12:18:54.829242821 +0000 UTC m=+74.803290000"
Sep 06 12:18:54.842440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.842403    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g6tjq" podStartSLOduration=67.223758257 podStartE2EDuration="1m14.842390317s" totalImagesPullingTime="7.61863206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:54.841756826 +0000 UTC m=+74.815804003" watchObservedRunningTime="2026-09-06 12:18:54.842390317 +0000 UTC m=+74.816437501"
Sep 06 12:18:54.855846 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.855808    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rv585" podStartSLOduration=33.458116786 podStartE2EDuration="40.855792673s" totalImagesPullingTime="7.397675887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:54.855358063 +0000 UTC m=+74.829405249" watchObservedRunningTime="2026-09-06 12:18:54.855792673 +0000 UTC m=+74.829839858"
Sep 06 12:18:54.868924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.868888    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dzk4s" podStartSLOduration=67.565750314 podStartE2EDuration="1m14.86887751s" totalImagesPullingTime="7.303127196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:54.868266745 +0000 UTC m=+74.842313931" watchObservedRunningTime="2026-09-06 12:18:54.86887751 +0000 UTC m=+74.842924694"
Sep 06 12:18:54.881662 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.881628    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567bc5b6d4-g75kl" podStartSLOduration=1.756870096 podStartE2EDuration="9.881621394s" totalImagesPullingTime="8.124751298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:54.880765963 +0000 UTC m=+74.854813149" watchObservedRunningTime="2026-09-06 12:18:54.881621394 +0000 UTC m=+74.855668572"
Sep 06 12:18:54.956736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:54.956715    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:55.012631 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:55.012587    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:55.328319 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:55.328279    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:55.435759 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:55.435736    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:55.496466 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:55.496441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:55.760079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:55.760059    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:56.314587 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:56.314561    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:56.414918 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:56.414891    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:56.536201 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:56.536173    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:56.833009 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:56.832983    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:56.884729 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:56.884697    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:59.110229 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:59.110192    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:59.211335 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:59.211298    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:59.723463 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:59.723434    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:18:59.773267 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:18:59.773244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:01.354009 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:01.353969    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:01.403538 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:01.403507    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:01.514010 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:01.513983    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:01.576219 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:01.576112    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:01.656869 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:01.656808    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:03.544172 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:03.544145    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:04.129547 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:04.129518    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:04.190788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:04.190765    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:04.817437 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:04.817410    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rv585"
Sep 06 12:19:04.953128 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:04.953098    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:05.050186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.050158    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:05.104551 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.104493    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:05.654823 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.654796    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:05.865997 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.865957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:05.868893 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.868866    2568 patch_prober.go:28] interesting pod/image-registry-69b86fc7f4-gd8gc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 06 12:19:05.869044 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.868925    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc" podUID="26f41fbe-9998-4fa2-8346-3c355e8befae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 12:19:05.943004 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.942980    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dfjm6"]
Sep 06 12:19:05.949530 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.949510    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:05.951427 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.951405    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 12:19:05.951547 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.951476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 12:19:05.951634 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.951626    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 12:19:05.952106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.952087    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pmdxk\""
Sep 06 12:19:05.952289 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.952153    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 12:19:05.952289 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.952157    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 12:19:05.952462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.952165    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 12:19:05.977668 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:05.977631    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:06.094746 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.094718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-accelerators-collector-config\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.094854 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.094761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-wtmp\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.094854 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.094789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl4dd\" (UniqueName: \"kubernetes.io/projected/161c1b4f-a708-4bba-97ca-9ee00412bfa2-kube-api-access-fl4dd\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.094854 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.094840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/161c1b4f-a708-4bba-97ca-9ee00412bfa2-metrics-client-ca\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.095007 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.094870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-sys\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.095007 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.094931    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-tls\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.095007 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.094964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-root\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.095007 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.094986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-textfile\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.095201 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.095010    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.155231 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.155204    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:06.196129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-textfile\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196110    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196142    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-accelerators-collector-config\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196264    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-wtmp\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196292    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl4dd\" (UniqueName: \"kubernetes.io/projected/161c1b4f-a708-4bba-97ca-9ee00412bfa2-kube-api-access-fl4dd\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/161c1b4f-a708-4bba-97ca-9ee00412bfa2-metrics-client-ca\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196369    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-sys\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196534 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196406    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-tls\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196534 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196432    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-root\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196534 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196452    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-textfile\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196534 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-root\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196563    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-wtmp\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.196630    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161c1b4f-a708-4bba-97ca-9ee00412bfa2-sys\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.196741 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:19:06.196685    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 06 12:19:06.196882 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:19:06.196753    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-tls podName:161c1b4f-a708-4bba-97ca-9ee00412bfa2 nodeName:}" failed. No retries permitted until 2026-09-06 12:19:06.696734435 +0000 UTC m=+86.670781607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-tls") pod "node-exporter-dfjm6" (UID: "161c1b4f-a708-4bba-97ca-9ee00412bfa2") : secret "node-exporter-tls" not found
Sep 06 12:19:06.197147 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.197128    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-accelerators-collector-config\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.197590 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.197570    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/161c1b4f-a708-4bba-97ca-9ee00412bfa2-metrics-client-ca\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.199347 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.199287    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.207924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.207903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl4dd\" (UniqueName: \"kubernetes.io/projected/161c1b4f-a708-4bba-97ca-9ee00412bfa2-kube-api-access-fl4dd\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.333799 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.333776    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:06.433857 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.433822    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:06.536044 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.535991    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:06.634508 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.634487    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:06.699790 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.699762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-tls\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.702104 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.702078    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/161c1b4f-a708-4bba-97ca-9ee00412bfa2-node-exporter-tls\") pod \"node-exporter-dfjm6\" (UID: \"161c1b4f-a708-4bba-97ca-9ee00412bfa2\") " pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.859939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.859879    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dfjm6"
Sep 06 12:19:06.873175 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:19:06.873152    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161c1b4f_a708_4bba_97ca_9ee00412bfa2.slice/crio-734bdb6eece349f5a5a0ec78870616ef74b9947bc4bd047154350acf2102684b WatchSource:0}: Error finding container 734bdb6eece349f5a5a0ec78870616ef74b9947bc4bd047154350acf2102684b: Status 404 returned error can't find the container with id 734bdb6eece349f5a5a0ec78870616ef74b9947bc4bd047154350acf2102684b
Sep 06 12:19:06.875962 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.875939    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:06.968947 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:06.968917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:07.198241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:07.198218    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:07.782256 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:07.782215    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69b86fc7f4-gd8gc"
Sep 06 12:19:07.802998 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:07.802957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:07.858531 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:07.858496    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dfjm6" event={"ID":"161c1b4f-a708-4bba-97ca-9ee00412bfa2","Type":"ContainerStarted","Data":"734bdb6eece349f5a5a0ec78870616ef74b9947bc4bd047154350acf2102684b"}
Sep 06 12:19:07.863915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:07.863883    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:07.932369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:07.932337    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:08.836561 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:08.836529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:08.863778 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:08.863750    2568 generic.go:356] "Generic (PLEG): container finished" podID="161c1b4f-a708-4bba-97ca-9ee00412bfa2" containerID="c12ce8da486c9e2ede75c9e76b75e1cff691c39703c98285a1f3b1916e14a929" exitCode=0
Sep 06 12:19:08.863911 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:08.863796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dfjm6" event={"ID":"161c1b4f-a708-4bba-97ca-9ee00412bfa2","Type":"ContainerDied","Data":"c12ce8da486c9e2ede75c9e76b75e1cff691c39703c98285a1f3b1916e14a929"}
Sep 06 12:19:08.884232 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:08.884145    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:08.946948 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:08.946922    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:09.019155 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:09.019123    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:09.394729 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:09.394689    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:09.496001 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:09.495972    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:09.869296 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:09.869269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dfjm6" event={"ID":"161c1b4f-a708-4bba-97ca-9ee00412bfa2","Type":"ContainerStarted","Data":"3abc8bc4437e044a76ee7855b7148c8024a56c89e925c0cf387d230e92c7fab6"}
Sep 06 12:19:09.869418 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:09.869313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dfjm6" event={"ID":"161c1b4f-a708-4bba-97ca-9ee00412bfa2","Type":"ContainerStarted","Data":"3950a31733ab166a5309282d7c9579ac75c2ec1214e81263532e0b52481f7309"}
Sep 06 12:19:09.887042 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:09.887001    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dfjm6" podStartSLOduration=3.706113156 podStartE2EDuration="4.886985916s" totalImagesPullingTime="1.114110551s" totalInitContainerRuntime="66.762209ms" isStatefulPod=true podCreationTimestamp="2026-09-06 12:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:19:09.885473482 +0000 UTC m=+89.859520682" watchObservedRunningTime="2026-09-06 12:19:09.886985916 +0000 UTC m=+89.861033101"
Sep 06 12:19:10.683042 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:10.683010    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:10.773137 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:10.773105    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:10.834820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:10.834769    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:11.833649 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:11.833617    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:11.932726 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:11.932702    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:12.175844 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:12.175778    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:13.758060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:13.758022    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:13.803261 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:13.803234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:13.921897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:13.921871    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:14.023954 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:14.023882    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:15.946968 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:15.946939    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:16.047231 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:16.047199    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:17.128833 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:17.128806    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:17.196803 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:17.196772    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:17.253897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:17.253874    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:18.556479 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:18.556441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:18.608574 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:18.608537    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:21.232786 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:21.232745    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:21.282317 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:21.282285    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:21.338430 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:21.338397    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:22.940529 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:22.940494    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:23.042067 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:23.042026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:25.817524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:25.817497    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wfbzs"
Sep 06 12:19:26.835760 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:26.835720    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:26.936235 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:26.936201    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:27.569860 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:27.569826    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:27.670588 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:27.670544    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:41.836817 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:41.836782    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:41.885639 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:41.885582    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:43.608616 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:43.608563    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:43.656941 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:43.656917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:19:51.460076 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:19:51.460042    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:25.083020 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:25.082986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:25.284002 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:25.283967    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:34.683476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:34.683396    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:40.292041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:40.292001    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:40.340432 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:40.340399    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:41.160846 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:41.160813    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:52.216324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:52.216281    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:52.269757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:52.269723    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:52.687150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:52.687067    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:52.741900 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:52.741871    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:52.796840 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:52.796818    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:56.839908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:56.839873    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:20:56.943382 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:20:56.943354    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:21:19.231033 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:21:19.230996    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:21:19.282584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:21:19.282546    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:21:37.899901 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:21:37.899852    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:21:38.000174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:21:38.000141    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:21:59.439874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:21:59.439839    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:00.224070 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:00.224039    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:02.826736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:02.826645    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:02.878159 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:02.878121    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:07.431338 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:07.431308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:07.491021 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:07.490986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:07.924261 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:07.924240    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:08.029040 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:08.029009    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:08.328369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:08.328340    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:08.438756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:08.438726    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:09.841085 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.841056    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"]
Sep 06 12:22:09.844153 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.844138    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:09.846178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.846157    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 12:22:09.846843 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.846825    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 12:22:09.846902 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.846841    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-88lvk\""
Sep 06 12:22:09.852196 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.852173    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"]
Sep 06 12:22:09.940502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.940480    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:09.940633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.940517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchvv\" (UniqueName: \"kubernetes.io/projected/beabb6e1-7329-4b37-8113-8fc95d597f53-kube-api-access-dchvv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:09.940633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:09.940543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:10.041776 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.041757    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchvv\" (UniqueName: \"kubernetes.io/projected/beabb6e1-7329-4b37-8113-8fc95d597f53-kube-api-access-dchvv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:10.041871 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.041783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:10.041871 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.041832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:10.042137 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.042120    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:10.042173 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.042153    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:10.051733 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.051708    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchvv\" (UniqueName: \"kubernetes.io/projected/beabb6e1-7329-4b37-8113-8fc95d597f53-kube-api-access-dchvv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:10.128239 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.128177    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:10.154052 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.154021    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:10.313009 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.312978    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:10.423794 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.423729    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"]
Sep 06 12:22:10.426578 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:22:10.426549    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeabb6e1_7329_4b37_8113_8fc95d597f53.slice/crio-5533f1e8fa86af5c498888c5bb1ff773b9cbccbb893daf4accac8c86c32aeeb6 WatchSource:0}: Error finding container 5533f1e8fa86af5c498888c5bb1ff773b9cbccbb893daf4accac8c86c32aeeb6: Status 404 returned error can't find the container with id 5533f1e8fa86af5c498888c5bb1ff773b9cbccbb893daf4accac8c86c32aeeb6
Sep 06 12:22:10.446400 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:10.446372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc" event={"ID":"beabb6e1-7329-4b37-8113-8fc95d597f53","Type":"ContainerStarted","Data":"5533f1e8fa86af5c498888c5bb1ff773b9cbccbb893daf4accac8c86c32aeeb6"}
Sep 06 12:22:14.554528 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:14.554491    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:14.655946 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:14.655909    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:16.471402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:16.471370    2568 generic.go:356] "Generic (PLEG): container finished" podID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerID="76448a164594cf090c3a4c86e3744094954ea0dff5c8ec0b199aad7889d73597" exitCode=0
Sep 06 12:22:16.471729 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:16.471455    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc" event={"ID":"beabb6e1-7329-4b37-8113-8fc95d597f53","Type":"ContainerDied","Data":"76448a164594cf090c3a4c86e3744094954ea0dff5c8ec0b199aad7889d73597"}
Sep 06 12:22:18.480263 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:18.480222    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc" event={"ID":"beabb6e1-7329-4b37-8113-8fc95d597f53","Type":"ContainerStarted","Data":"2880c06d9c5257615e1886eab127c752c8978c4caaf4b8ad6e1556f785d7d63e"}
Sep 06 12:22:18.530783 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:18.530754    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:19.485904 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:19.485866    2568 generic.go:356] "Generic (PLEG): container finished" podID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerID="2880c06d9c5257615e1886eab127c752c8978c4caaf4b8ad6e1556f785d7d63e" exitCode=0
Sep 06 12:22:19.486275 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:19.485950    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc" event={"ID":"beabb6e1-7329-4b37-8113-8fc95d597f53","Type":"ContainerDied","Data":"2880c06d9c5257615e1886eab127c752c8978c4caaf4b8ad6e1556f785d7d63e"}
Sep 06 12:22:26.515727 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:26.515702    2568 generic.go:356] "Generic (PLEG): container finished" podID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerID="98b1507f2fe66bd4ed7c6fd281f4fb0e70bb651eced56bc58b66e2853aaf47af" exitCode=0
Sep 06 12:22:26.516054 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:26.515793    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc" event={"ID":"beabb6e1-7329-4b37-8113-8fc95d597f53","Type":"ContainerDied","Data":"98b1507f2fe66bd4ed7c6fd281f4fb0e70bb651eced56bc58b66e2853aaf47af"}
Sep 06 12:22:27.641878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.641848    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:27.766500 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.766473    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-util\") pod \"beabb6e1-7329-4b37-8113-8fc95d597f53\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") "
Sep 06 12:22:27.766667 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.766509    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-bundle\") pod \"beabb6e1-7329-4b37-8113-8fc95d597f53\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") "
Sep 06 12:22:27.766667 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.766551    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dchvv\" (UniqueName: \"kubernetes.io/projected/beabb6e1-7329-4b37-8113-8fc95d597f53-kube-api-access-dchvv\") pod \"beabb6e1-7329-4b37-8113-8fc95d597f53\" (UID: \"beabb6e1-7329-4b37-8113-8fc95d597f53\") "
Sep 06 12:22:27.766909 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.766883    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-bundle" (OuterVolumeSpecName: "bundle") pod "beabb6e1-7329-4b37-8113-8fc95d597f53" (UID: "beabb6e1-7329-4b37-8113-8fc95d597f53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:22:27.768679 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.768654    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beabb6e1-7329-4b37-8113-8fc95d597f53-kube-api-access-dchvv" (OuterVolumeSpecName: "kube-api-access-dchvv") pod "beabb6e1-7329-4b37-8113-8fc95d597f53" (UID: "beabb6e1-7329-4b37-8113-8fc95d597f53"). InnerVolumeSpecName "kube-api-access-dchvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:22:27.771440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.771396    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-util" (OuterVolumeSpecName: "util") pod "beabb6e1-7329-4b37-8113-8fc95d597f53" (UID: "beabb6e1-7329-4b37-8113-8fc95d597f53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:22:27.867818 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.867796    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-util\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:22:27.867818 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.867815    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beabb6e1-7329-4b37-8113-8fc95d597f53-bundle\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:22:27.867934 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:27.867824    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dchvv\" (UniqueName: \"kubernetes.io/projected/beabb6e1-7329-4b37-8113-8fc95d597f53-kube-api-access-dchvv\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:22:28.523770 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:28.523750    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc"
Sep 06 12:22:28.523770 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:28.523762    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xpsc" event={"ID":"beabb6e1-7329-4b37-8113-8fc95d597f53","Type":"ContainerDied","Data":"5533f1e8fa86af5c498888c5bb1ff773b9cbccbb893daf4accac8c86c32aeeb6"}
Sep 06 12:22:28.523901 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:28.523802    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5533f1e8fa86af5c498888c5bb1ff773b9cbccbb893daf4accac8c86c32aeeb6"
Sep 06 12:22:31.138851 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:31.138820    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:31.240285 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:31.240253    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:32.854237 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.854205    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"]
Sep 06 12:22:32.854641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.854412    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerName="util"
Sep 06 12:22:32.854641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.854422    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerName="util"
Sep 06 12:22:32.854641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.854433    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerName="extract"
Sep 06 12:22:32.854641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.854439    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerName="extract"
Sep 06 12:22:32.854641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.854446    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerName="pull"
Sep 06 12:22:32.854641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.854452    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerName="pull"
Sep 06 12:22:32.854641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.854494    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="beabb6e1-7329-4b37-8113-8fc95d597f53" containerName="extract"
Sep 06 12:22:32.873407 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.873379    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"]
Sep 06 12:22:32.873523 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.873458    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"
Sep 06 12:22:32.875708 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.875680    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 06 12:22:32.875708 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.875704    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-l85tv\""
Sep 06 12:22:32.875896 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.875714    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:22:32.999010 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.998981    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p6n9z\" (UID: \"9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"
Sep 06 12:22:32.999010 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:32.999011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhhcc\" (UniqueName: \"kubernetes.io/projected/9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67-kube-api-access-xhhcc\") pod \"openshift-lws-operator-fd8ccff4c-p6n9z\" (UID: \"9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"
Sep 06 12:22:33.099230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:33.099204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p6n9z\" (UID: \"9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"
Sep 06 12:22:33.099327 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:33.099232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhhcc\" (UniqueName: \"kubernetes.io/projected/9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67-kube-api-access-xhhcc\") pod \"openshift-lws-operator-fd8ccff4c-p6n9z\" (UID: \"9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"
Sep 06 12:22:33.099565 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:33.099547    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p6n9z\" (UID: \"9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"
Sep 06 12:22:33.106355 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:33.106297    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhhcc\" (UniqueName: \"kubernetes.io/projected/9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67-kube-api-access-xhhcc\") pod \"openshift-lws-operator-fd8ccff4c-p6n9z\" (UID: \"9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"
Sep 06 12:22:33.182239 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:33.182216    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"
Sep 06 12:22:33.471547 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:33.471520    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z"]
Sep 06 12:22:33.474690 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:22:33.474654    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bf4c0ca_e3f9_4a34_a57f_171c9e6eac67.slice/crio-8784053ad2e3e2084cf65069de542437d7ca10eb0208bd0086ba4d379b9326ea WatchSource:0}: Error finding container 8784053ad2e3e2084cf65069de542437d7ca10eb0208bd0086ba4d379b9326ea: Status 404 returned error can't find the container with id 8784053ad2e3e2084cf65069de542437d7ca10eb0208bd0086ba4d379b9326ea
Sep 06 12:22:33.541452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:33.541430    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z" event={"ID":"9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67","Type":"ContainerStarted","Data":"8784053ad2e3e2084cf65069de542437d7ca10eb0208bd0086ba4d379b9326ea"}
Sep 06 12:22:36.554078 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:36.554044    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z" event={"ID":"9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67","Type":"ContainerStarted","Data":"d054d997c3e1ebdb2a108a3ce5ba2b31592f4ac433283df187d7a17c9e3b5916"}
Sep 06 12:22:36.568641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:36.568568    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6n9z" podStartSLOduration=2.188211285 podStartE2EDuration="4.568553019s" totalImagesPullingTime="2.380341734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:22:36.567067759 +0000 UTC m=+296.541114944" watchObservedRunningTime="2026-09-06 12:22:36.568553019 +0000 UTC m=+296.542600204"
Sep 06 12:22:37.312344 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:37.312310    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:37.363769 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:37.363738    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:39.524972 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:39.524938    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:40.459666 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:40.459640    2568 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 12:22:46.088647 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:46.088614    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:53.743617 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.743564    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"]
Sep 06 12:22:53.746751 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.746732    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:53.748880 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.748862    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 12:22:53.749494 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.749479    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 12:22:53.749542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.749481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-88lvk\""
Sep 06 12:22:53.758666 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.758645    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"]
Sep 06 12:22:53.933213 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.933186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfwl8\" (UniqueName: \"kubernetes.io/projected/1687bb3a-1fd6-49a1-85ce-4acf097d867d-kube-api-access-jfwl8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:53.933328 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.933227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:53.933328 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:53.933254    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:54.034537 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.034484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfwl8\" (UniqueName: \"kubernetes.io/projected/1687bb3a-1fd6-49a1-85ce-4acf097d867d-kube-api-access-jfwl8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:54.034537 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.034521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:54.034687 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.034546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:54.034837 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.034822    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:54.034916 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.034899    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:54.061560 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.061533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfwl8\" (UniqueName: \"kubernetes.io/projected/1687bb3a-1fd6-49a1-85ce-4acf097d867d-kube-api-access-jfwl8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:54.355444 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.355391    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:54.486647 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.486589    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:54.587289 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.587254    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:54.628085 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:54.628002    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"]
Sep 06 12:22:54.633221 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:22:54.633195    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1687bb3a_1fd6_49a1_85ce_4acf097d867d.slice/crio-5bde82801f3f4b40cb6c47c065e26f9510c27ebe146e4e298bc2636f0e6ad76c WatchSource:0}: Error finding container 5bde82801f3f4b40cb6c47c065e26f9510c27ebe146e4e298bc2636f0e6ad76c: Status 404 returned error can't find the container with id 5bde82801f3f4b40cb6c47c065e26f9510c27ebe146e4e298bc2636f0e6ad76c
Sep 06 12:22:55.028483 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.028448    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:55.292288 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.292226    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:55.399316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.399294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:55.443964 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.443941    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"]
Sep 06 12:22:55.446944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.446930    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.449445 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.449428    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 12:22:55.449831 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.449814    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 12:22:55.449932 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.449918    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lvcwj\""
Sep 06 12:22:55.450122 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.450106    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 12:22:55.450166 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.450106    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 12:22:55.460123 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.460101    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"]
Sep 06 12:22:55.544828 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.544783    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c040933-d571-4cce-a6bf-12ae30bfa457-manifests\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.544828 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.544809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c040933-d571-4cce-a6bf-12ae30bfa457-tmp\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.544954 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.544827    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwbds\" (UniqueName: \"kubernetes.io/projected/8c040933-d571-4cce-a6bf-12ae30bfa457-kube-api-access-lwbds\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.544954 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.544852    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c040933-d571-4cce-a6bf-12ae30bfa457-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.544954 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.544869    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c040933-d571-4cce-a6bf-12ae30bfa457-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.575531 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.575506    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:55.620507 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.620490    2568 generic.go:356] "Generic (PLEG): container finished" podID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerID="b7805a32d2d7a8b0485e5ce96a9635ed4e7adbd1982761e1bb06607e35b6a862" exitCode=0
Sep 06 12:22:55.620640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.620515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq" event={"ID":"1687bb3a-1fd6-49a1-85ce-4acf097d867d","Type":"ContainerDied","Data":"b7805a32d2d7a8b0485e5ce96a9635ed4e7adbd1982761e1bb06607e35b6a862"}
Sep 06 12:22:55.620640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.620550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq" event={"ID":"1687bb3a-1fd6-49a1-85ce-4acf097d867d","Type":"ContainerStarted","Data":"5bde82801f3f4b40cb6c47c065e26f9510c27ebe146e4e298bc2636f0e6ad76c"}
Sep 06 12:22:55.621046 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.621028    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:22:55.645850 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.645821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c040933-d571-4cce-a6bf-12ae30bfa457-tmp\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.645850 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.645848    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwbds\" (UniqueName: \"kubernetes.io/projected/8c040933-d571-4cce-a6bf-12ae30bfa457-kube-api-access-lwbds\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.645967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.645873    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c040933-d571-4cce-a6bf-12ae30bfa457-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.645967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.645889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c040933-d571-4cce-a6bf-12ae30bfa457-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.645967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.645940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c040933-d571-4cce-a6bf-12ae30bfa457-manifests\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.646326 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.646304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c040933-d571-4cce-a6bf-12ae30bfa457-manifests\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.648251 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.648227    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c040933-d571-4cce-a6bf-12ae30bfa457-tmp\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.648366 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.648352    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c040933-d571-4cce-a6bf-12ae30bfa457-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.648429 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.648411    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c040933-d571-4cce-a6bf-12ae30bfa457-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.650158 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.650121    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:55.653517 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.653498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwbds\" (UniqueName: \"kubernetes.io/projected/8c040933-d571-4cce-a6bf-12ae30bfa457-kube-api-access-lwbds\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4\" (UID: \"8c040933-d571-4cce-a6bf-12ae30bfa457\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.753640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.753587    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:55.756488 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.756472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:22:55.850742 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.850713    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:55.953317 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:55.953288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:56.011109 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:56.011088    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:56.027194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:56.027174    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"]
Sep 06 12:22:56.029495 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:22:56.029460    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c040933_d571_4cce_a6bf_12ae30bfa457.slice/crio-b0391516d52f1dfd87cc0a10a0dfafd2331f0259b011b342455746c977d946d9 WatchSource:0}: Error finding container b0391516d52f1dfd87cc0a10a0dfafd2331f0259b011b342455746c977d946d9: Status 404 returned error can't find the container with id b0391516d52f1dfd87cc0a10a0dfafd2331f0259b011b342455746c977d946d9
Sep 06 12:22:56.090540 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:56.090484    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:56.191054 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:56.191024    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:56.626749 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:56.626721    2568 generic.go:356] "Generic (PLEG): container finished" podID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerID="83982d3f8a1609da152936b61dd8a899d9d944835a78c6bdfbcb1f3e3f0228ea" exitCode=0
Sep 06 12:22:56.626917 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:56.626800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq" event={"ID":"1687bb3a-1fd6-49a1-85ce-4acf097d867d","Type":"ContainerDied","Data":"83982d3f8a1609da152936b61dd8a899d9d944835a78c6bdfbcb1f3e3f0228ea"}
Sep 06 12:22:56.628226 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:56.628205    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4" event={"ID":"8c040933-d571-4cce-a6bf-12ae30bfa457","Type":"ContainerStarted","Data":"b0391516d52f1dfd87cc0a10a0dfafd2331f0259b011b342455746c977d946d9"}
Sep 06 12:22:57.636926 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:57.636830    2568 generic.go:356] "Generic (PLEG): container finished" podID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerID="a0f1396cced78c38f1c8ff8316f0d5a4ff45fdc5ccfb16e5052397dab8303e38" exitCode=0
Sep 06 12:22:57.637384 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:57.637000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq" event={"ID":"1687bb3a-1fd6-49a1-85ce-4acf097d867d","Type":"ContainerDied","Data":"a0f1396cced78c38f1c8ff8316f0d5a4ff45fdc5ccfb16e5052397dab8303e38"}
Sep 06 12:22:57.790063 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:57.790012    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:57.896020 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:57.895933    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:22:58.961265 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:58.961244    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:59.072070 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.072044    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-util\") pod \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") "
Sep 06 12:22:59.072264 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.072239    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfwl8\" (UniqueName: \"kubernetes.io/projected/1687bb3a-1fd6-49a1-85ce-4acf097d867d-kube-api-access-jfwl8\") pod \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") "
Sep 06 12:22:59.072264 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.072285    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-bundle\") pod \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\" (UID: \"1687bb3a-1fd6-49a1-85ce-4acf097d867d\") "
Sep 06 12:22:59.073579 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.073548    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-bundle" (OuterVolumeSpecName: "bundle") pod "1687bb3a-1fd6-49a1-85ce-4acf097d867d" (UID: "1687bb3a-1fd6-49a1-85ce-4acf097d867d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:22:59.074802 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.074778    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1687bb3a-1fd6-49a1-85ce-4acf097d867d-kube-api-access-jfwl8" (OuterVolumeSpecName: "kube-api-access-jfwl8") pod "1687bb3a-1fd6-49a1-85ce-4acf097d867d" (UID: "1687bb3a-1fd6-49a1-85ce-4acf097d867d"). InnerVolumeSpecName "kube-api-access-jfwl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:22:59.078685 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.078663    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-util" (OuterVolumeSpecName: "util") pod "1687bb3a-1fd6-49a1-85ce-4acf097d867d" (UID: "1687bb3a-1fd6-49a1-85ce-4acf097d867d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:22:59.174210 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.174186    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-util\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:22:59.174210 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.174206    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfwl8\" (UniqueName: \"kubernetes.io/projected/1687bb3a-1fd6-49a1-85ce-4acf097d867d-kube-api-access-jfwl8\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:22:59.174322 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.174216    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1687bb3a-1fd6-49a1-85ce-4acf097d867d-bundle\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:22:59.649891 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.649848    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4" event={"ID":"8c040933-d571-4cce-a6bf-12ae30bfa457","Type":"ContainerStarted","Data":"23db9bcc04aa647d7ae043e042af6ddc890744d22e64ac2aebe4bd3e812a31df"}
Sep 06 12:22:59.652404 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.652380    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq"
Sep 06 12:22:59.652517 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.652376    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zk7nq" event={"ID":"1687bb3a-1fd6-49a1-85ce-4acf097d867d","Type":"ContainerDied","Data":"5bde82801f3f4b40cb6c47c065e26f9510c27ebe146e4e298bc2636f0e6ad76c"}
Sep 06 12:22:59.652517 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:22:59.652494    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bde82801f3f4b40cb6c47c065e26f9510c27ebe146e4e298bc2636f0e6ad76c"
Sep 06 12:23:00.657451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:00.657423    2568 generic.go:356] "Generic (PLEG): container finished" podID="8c040933-d571-4cce-a6bf-12ae30bfa457" containerID="23db9bcc04aa647d7ae043e042af6ddc890744d22e64ac2aebe4bd3e812a31df" exitCode=0
Sep 06 12:23:00.657798 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:00.657455    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4" event={"ID":"8c040933-d571-4cce-a6bf-12ae30bfa457","Type":"ContainerDied","Data":"23db9bcc04aa647d7ae043e042af6ddc890744d22e64ac2aebe4bd3e812a31df"}
Sep 06 12:23:01.664614 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:01.664575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4" event={"ID":"8c040933-d571-4cce-a6bf-12ae30bfa457","Type":"ContainerStarted","Data":"a08b25b5cbd2c04dcd15ca405b7a2b8dec51989da9e07fa2e29b35e8c323de6a"}
Sep 06 12:23:01.665028 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:01.664728    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:23:01.682894 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:01.682846    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4" podStartSLOduration=2.325797017 podStartE2EDuration="6.682831972s" totalImagesPullingTime="3.272831313s" totalInitContainerRuntime="1.084203642s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:22:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:01.682796681 +0000 UTC m=+321.656843868" watchObservedRunningTime="2026-09-06 12:23:01.682831972 +0000 UTC m=+321.656879157"
Sep 06 12:23:03.869465 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:03.869426    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:03.945159 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:03.945119    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:12.674542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:12.674511    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4"
Sep 06 12:23:14.715633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.715573    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:14.799298 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.799258    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:14.952998 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.952967    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:14.985043 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.984979    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-766996c99d-qgb54"]
Sep 06 12:23:14.985238 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.985225    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerName="pull"
Sep 06 12:23:14.985286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.985240    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerName="pull"
Sep 06 12:23:14.985286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.985251    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerName="util"
Sep 06 12:23:14.985286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.985257    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerName="util"
Sep 06 12:23:14.985286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.985267    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerName="extract"
Sep 06 12:23:14.985286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.985273    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerName="extract"
Sep 06 12:23:14.985454 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.985312    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1687bb3a-1fd6-49a1-85ce-4acf097d867d" containerName="extract"
Sep 06 12:23:14.996401 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.996378    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:14.998526 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.998503    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 06 12:23:14.998897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.998878    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tb5zp\""
Sep 06 12:23:14.999152 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.999137    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 12:23:14.999545 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.999523    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 12:23:14.999654 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.999551    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 06 12:23:14.999780 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:14.999764    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-766996c99d-qgb54"]
Sep 06 12:23:15.076138 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.076115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-279xb\" (UniqueName: \"kubernetes.io/projected/94c6aca3-cc78-414a-9019-0c3936432c3a-kube-api-access-279xb\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.076219 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.076144    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c6aca3-cc78-414a-9019-0c3936432c3a-tls-certs\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.076219 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.076179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94c6aca3-cc78-414a-9019-0c3936432c3a-tmp\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.175196 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.175165    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:15.177096 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.177077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-279xb\" (UniqueName: \"kubernetes.io/projected/94c6aca3-cc78-414a-9019-0c3936432c3a-kube-api-access-279xb\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.177173 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.177109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c6aca3-cc78-414a-9019-0c3936432c3a-tls-certs\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.177173 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.177144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94c6aca3-cc78-414a-9019-0c3936432c3a-tmp\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.179445 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.179421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94c6aca3-cc78-414a-9019-0c3936432c3a-tmp\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.179531 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.179505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c6aca3-cc78-414a-9019-0c3936432c3a-tls-certs\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.183998 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.183981    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-279xb\" (UniqueName: \"kubernetes.io/projected/94c6aca3-cc78-414a-9019-0c3936432c3a-kube-api-access-279xb\") pod \"kube-auth-proxy-766996c99d-qgb54\" (UID: \"94c6aca3-cc78-414a-9019-0c3936432c3a\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.307743 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.307690    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54"
Sep 06 12:23:15.579123 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.579036    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-766996c99d-qgb54"]
Sep 06 12:23:15.581673 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:23:15.581647    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c6aca3_cc78_414a_9019_0c3936432c3a.slice/crio-3e11e7f41ab06d0c66eadf02c3840b6e236793e9b7498dc29a06684eb57dfd72 WatchSource:0}: Error finding container 3e11e7f41ab06d0c66eadf02c3840b6e236793e9b7498dc29a06684eb57dfd72: Status 404 returned error can't find the container with id 3e11e7f41ab06d0c66eadf02c3840b6e236793e9b7498dc29a06684eb57dfd72
Sep 06 12:23:15.720964 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:15.720939    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54" event={"ID":"94c6aca3-cc78-414a-9019-0c3936432c3a","Type":"ContainerStarted","Data":"3e11e7f41ab06d0c66eadf02c3840b6e236793e9b7498dc29a06684eb57dfd72"}
Sep 06 12:23:16.183359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:16.183316    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:16.282440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:16.282398    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:17.109619 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:17.109569    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:18.736042 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:18.736010    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54" event={"ID":"94c6aca3-cc78-414a-9019-0c3936432c3a","Type":"ContainerStarted","Data":"93800033c8f0344d467b7085922dee50f8379efab36884ba5fe17c683ff6a1ce"}
Sep 06 12:23:18.756249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:18.756204    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-766996c99d-qgb54" podStartSLOduration=1.981751332 podStartE2EDuration="4.756189693s" totalImagesPullingTime="2.774438361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:23:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:18.754802805 +0000 UTC m=+338.728850001" watchObservedRunningTime="2026-09-06 12:23:18.756189693 +0000 UTC m=+338.730236878"
Sep 06 12:23:20.353802 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:20.353770    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:20.462752 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:20.462720    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:20.911397 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:20.911373    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"]
Sep 06 12:23:20.914232 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:20.914213    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:20.916254 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:20.916233    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zkwmz\""
Sep 06 12:23:20.916407 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:20.916387    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 12:23:20.926284 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:20.926263    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"]
Sep 06 12:23:20.940264 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:20.940242    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:21.016834 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.016814    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.016944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.016853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.016944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.016883    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.016944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.016905    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.016944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.016930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.017150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.016962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.017150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.016995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.017150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.017018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scpm6\" (UniqueName: \"kubernetes.io/projected/37bf3739-7bbd-4568-aa84-f92fa40fae50-kube-api-access-scpm6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.017150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.017057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37bf3739-7bbd-4568-aa84-f92fa40fae50-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118323 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118412 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118412 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scpm6\" (UniqueName: \"kubernetes.io/projected/37bf3739-7bbd-4568-aa84-f92fa40fae50-kube-api-access-scpm6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118412 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118381    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37bf3739-7bbd-4568-aa84-f92fa40fae50-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118571 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118571 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118467    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118571 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118571 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118516    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118571 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.118947 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118925    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.119047 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.118964    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.119094 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.119055    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.119194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.119119    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.119255 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.119215    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37bf3739-7bbd-4568-aa84-f92fa40fae50-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.120926 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.120896    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.121010 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.120999    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.128732 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.128713    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37bf3739-7bbd-4568-aa84-f92fa40fae50-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.129259 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.129229    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scpm6\" (UniqueName: \"kubernetes.io/projected/37bf3739-7bbd-4568-aa84-f92fa40fae50-kube-api-access-scpm6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz\" (UID: \"37bf3739-7bbd-4568-aa84-f92fa40fae50\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.155982 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.155957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:21.224717 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.224696    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:21.256564 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.256533    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:21.357372 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.357343    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:21.496031 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.495521    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"]
Sep 06 12:23:21.748144 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:21.748086    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz" event={"ID":"37bf3739-7bbd-4568-aa84-f92fa40fae50","Type":"ContainerStarted","Data":"23ca57c04750f99b9303deeea38987295f14eca8861982a5f77d8a9221fdbb1b"}
Sep 06 12:23:23.149528 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:23.149488    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:23.249814 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:23.249787    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:24.282641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:24.282575    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:23:24.282914 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:24.282677    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:23:24.282914 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:24.282707    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:23:24.763194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:24.763162    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz" event={"ID":"37bf3739-7bbd-4568-aa84-f92fa40fae50","Type":"ContainerStarted","Data":"812deba3e8e6df5cb6e7e42d43dbd04af15b1b1b173d0e467f5b9b3212be58b5"}
Sep 06 12:23:24.784615 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:24.784556    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz" podStartSLOduration=2.003289911 podStartE2EDuration="4.784540613s" totalImagesPullingTime="2.781250702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:24.783566467 +0000 UTC m=+344.757613676" watchObservedRunningTime="2026-09-06 12:23:24.784540613 +0000 UTC m=+344.758587798"
Sep 06 12:23:25.225468 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:25.225436    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:25.229523 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:25.229505    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:25.764467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:25.764423    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:25.766997 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:25.766975    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:25.767926 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:25.767909    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz"
Sep 06 12:23:25.866180 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:25.866150    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:25.964890 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:25.964860    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:26.225890 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.225863    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:26.255377 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.255355    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdjmj"]
Sep 06 12:23:26.258510 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.258495    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:26.260370 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.260352    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 06 12:23:26.260473 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.260423    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4c7dp\""
Sep 06 12:23:26.269137 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.269119    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdjmj"]
Sep 06 12:23:26.291890 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.291858    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:26.357587 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.357561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt2m2\" (UniqueName: \"kubernetes.io/projected/86bc2130-aaf0-4c40-a3af-409723c43a58-kube-api-access-zt2m2\") pod \"model-serving-api-54d89bd5fc-vdjmj\" (UID: \"86bc2130-aaf0-4c40-a3af-409723c43a58\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:26.357700 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.357631    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdjmj\" (UID: \"86bc2130-aaf0-4c40-a3af-409723c43a58\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:26.458633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.458580    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt2m2\" (UniqueName: \"kubernetes.io/projected/86bc2130-aaf0-4c40-a3af-409723c43a58-kube-api-access-zt2m2\") pod \"model-serving-api-54d89bd5fc-vdjmj\" (UID: \"86bc2130-aaf0-4c40-a3af-409723c43a58\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:26.458745 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.458664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdjmj\" (UID: \"86bc2130-aaf0-4c40-a3af-409723c43a58\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:26.458804 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:23:26.458782    2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 06 12:23:26.458857 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:23:26.458848    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs podName:86bc2130-aaf0-4c40-a3af-409723c43a58 nodeName:}" failed. No retries permitted until 2026-09-06 12:23:26.958828027 +0000 UTC m=+346.932875211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs") pod "model-serving-api-54d89bd5fc-vdjmj" (UID: "86bc2130-aaf0-4c40-a3af-409723c43a58") : secret "model-serving-api-tls" not found
Sep 06 12:23:26.466251 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.466228    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt2m2\" (UniqueName: \"kubernetes.io/projected/86bc2130-aaf0-4c40-a3af-409723c43a58-kube-api-access-zt2m2\") pod \"model-serving-api-54d89bd5fc-vdjmj\" (UID: \"86bc2130-aaf0-4c40-a3af-409723c43a58\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:26.961734 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:26.961707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdjmj\" (UID: \"86bc2130-aaf0-4c40-a3af-409723c43a58\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:26.962041 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:23:26.961810    2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 06 12:23:26.962041 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:23:26.961871    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs podName:86bc2130-aaf0-4c40-a3af-409723c43a58 nodeName:}" failed. No retries permitted until 2026-09-06 12:23:27.961854268 +0000 UTC m=+347.935901447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs") pod "model-serving-api-54d89bd5fc-vdjmj" (UID: "86bc2130-aaf0-4c40-a3af-409723c43a58") : secret "model-serving-api-tls" not found
Sep 06 12:23:27.061028 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:27.060995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:27.967712 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:27.967679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdjmj\" (UID: \"86bc2130-aaf0-4c40-a3af-409723c43a58\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:27.969992 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:27.969970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86bc2130-aaf0-4c40-a3af-409723c43a58-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdjmj\" (UID: \"86bc2130-aaf0-4c40-a3af-409723c43a58\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:28.069134 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:28.069100    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:28.335206 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:28.335131    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdjmj"]
Sep 06 12:23:28.338240 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:23:28.338218    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86bc2130_aaf0_4c40_a3af_409723c43a58.slice/crio-3acf855f901115da72f360fa4375e6a966e9831727be5308fcfb23baa4e45b12 WatchSource:0}: Error finding container 3acf855f901115da72f360fa4375e6a966e9831727be5308fcfb23baa4e45b12: Status 404 returned error can't find the container with id 3acf855f901115da72f360fa4375e6a966e9831727be5308fcfb23baa4e45b12
Sep 06 12:23:28.778823 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:28.778791    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj" event={"ID":"86bc2130-aaf0-4c40-a3af-409723c43a58","Type":"ContainerStarted","Data":"3acf855f901115da72f360fa4375e6a966e9831727be5308fcfb23baa4e45b12"}
Sep 06 12:23:30.788678 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:30.788643    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj" event={"ID":"86bc2130-aaf0-4c40-a3af-409723c43a58","Type":"ContainerStarted","Data":"b14f28ea4a52b4c914596d6a4d609c170445473c1dee24c5fde6fc785cd0581e"}
Sep 06 12:23:30.789113 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:30.788777    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:30.804145 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:30.804106    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj" podStartSLOduration=3.359505955 podStartE2EDuration="4.804091201s" totalImagesPullingTime="1.444585246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:30.802223283 +0000 UTC m=+350.776270478" watchObservedRunningTime="2026-09-06 12:23:30.804091201 +0000 UTC m=+350.778138385"
Sep 06 12:23:33.419335 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.419254    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"]
Sep 06 12:23:33.422448 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.422431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.425038 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.425012    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 06 12:23:33.425152 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.425046    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 06 12:23:33.425152 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.425112    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7kd99\""
Sep 06 12:23:33.425310 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.425294    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 06 12:23:33.430805 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.430778    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"]
Sep 06 12:23:33.507300 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.507278    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/911ab375-b54d-4fd7-87cf-05617b794bf2-manager-config\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.507394 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.507308    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/911ab375-b54d-4fd7-87cf-05617b794bf2-cert\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.507394 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.507331    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/911ab375-b54d-4fd7-87cf-05617b794bf2-metrics-cert\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.507473 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.507413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddsf\" (UniqueName: \"kubernetes.io/projected/911ab375-b54d-4fd7-87cf-05617b794bf2-kube-api-access-sddsf\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.608759 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.608723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/911ab375-b54d-4fd7-87cf-05617b794bf2-cert\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.608759 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.608767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/911ab375-b54d-4fd7-87cf-05617b794bf2-metrics-cert\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.608989 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.608803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sddsf\" (UniqueName: \"kubernetes.io/projected/911ab375-b54d-4fd7-87cf-05617b794bf2-kube-api-access-sddsf\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.608989 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.608830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/911ab375-b54d-4fd7-87cf-05617b794bf2-manager-config\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.609516 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.609495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/911ab375-b54d-4fd7-87cf-05617b794bf2-manager-config\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.611354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.611322    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/911ab375-b54d-4fd7-87cf-05617b794bf2-cert\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.611755 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.611734    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/911ab375-b54d-4fd7-87cf-05617b794bf2-metrics-cert\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.621557 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.621530    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddsf\" (UniqueName: \"kubernetes.io/projected/911ab375-b54d-4fd7-87cf-05617b794bf2-kube-api-access-sddsf\") pod \"lws-controller-manager-7c968668cd-2lv9k\" (UID: \"911ab375-b54d-4fd7-87cf-05617b794bf2\") " pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:33.731453 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:33.731429    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:34.020888 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:34.020824    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"]
Sep 06 12:23:34.023738 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:23:34.023716    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911ab375_b54d_4fd7_87cf_05617b794bf2.slice/crio-b330505516e8fa215b26618506849de36ea0ed35a25c09667b4596914c8add52 WatchSource:0}: Error finding container b330505516e8fa215b26618506849de36ea0ed35a25c09667b4596914c8add52: Status 404 returned error can't find the container with id b330505516e8fa215b26618506849de36ea0ed35a25c09667b4596914c8add52
Sep 06 12:23:34.310370 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:34.310265    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:34.393349 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:34.393319    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:34.576622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:34.576514    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:34.766038 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:34.766005    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:34.806359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:34.806327    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k" event={"ID":"911ab375-b54d-4fd7-87cf-05617b794bf2","Type":"ContainerStarted","Data":"b330505516e8fa215b26618506849de36ea0ed35a25c09667b4596914c8add52"}
Sep 06 12:23:35.566968 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:35.566943    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:35.666306 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:35.666275    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:35.766612 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:35.766582    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:35.812337 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:35.812274    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k" event={"ID":"911ab375-b54d-4fd7-87cf-05617b794bf2","Type":"ContainerStarted","Data":"f14e5a8bc65a28b7d4f730cc19c524f79adbcb0a1a88f886054ed6421bb32758"}
Sep 06 12:23:35.812443 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:35.812354    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:35.853638 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:35.853581    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k" podStartSLOduration=1.319067662 podStartE2EDuration="2.853560874s" totalImagesPullingTime="1.534493212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:35.852591477 +0000 UTC m=+355.826638661" watchObservedRunningTime="2026-09-06 12:23:35.853560874 +0000 UTC m=+355.827608059"
Sep 06 12:23:41.795816 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:41.795780    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vdjmj"
Sep 06 12:23:46.818765 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:46.818739    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c968668cd-2lv9k"
Sep 06 12:23:56.647387 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:56.647346    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:23:56.713293 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:23:56.713265    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:07.610318 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:07.610255    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:07.662811 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:07.662779    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:07.710203 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:07.710179    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:26.674174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:26.674136    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:26.768438 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:26.768407    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:46.190832 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:46.190799    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:49.012445 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:49.012405    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:50.804735 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:50.804695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:51.036620 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:51.036565    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:51.196819 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:51.196793    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:51.788264 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:51.788234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:52.431520 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:52.431486    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:53.446213 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:53.446180    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:54.800049 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:54.800012    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:55.030197 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:55.030163    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:55.200001 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:55.199971    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:55.302670 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:55.302641    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:58.593511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:58.593468    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:24:58.693962 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:24:58.693928    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:01.384495 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:01.384465    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:01.439874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:01.439829    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:01.600231 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:01.600161    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:01.652175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:01.652120    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:06.542018 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:06.541989    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:06.643938 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:06.643911    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:06.740276 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:06.740248    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:15.382512 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:15.382460    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:15.482983 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:15.482948    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:17.988472 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:17.988435    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:18.087967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:18.087933    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:20.974899 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:20.974870    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:21.075590 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:21.075555    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:26.564949 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:26.564912    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:26.622502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:26.622470    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:27.368335 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:27.368308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:27.426550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:27.426526    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:27.567866 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:27.567832    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:27.624851 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:27.624789    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:34.218832 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:34.218797    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:34.267044 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:34.267017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:34.549164 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:34.549084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:34.646365 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:34.646337    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:45.173966 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:45.173933    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:45.224771 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:45.224744    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:58.202555 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:58.202517    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:25:59.979929 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:25:59.979891    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:00.085055 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:00.085021    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:00.138130 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:00.138097    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:00.855226 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:00.855179    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:00.995971 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:00.995946    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-mgbcz"]
Sep 06 12:26:00.999174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:00.999155    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-mgbcz"
Sep 06 12:26:01.001906 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.001884    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j4j2v\""
Sep 06 12:26:01.002006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.001904    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 12:26:01.002113 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.002020    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 12:26:01.003936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.003914    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-mgbcz"]
Sep 06 12:26:01.095621 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.095569    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hsn6\" (UniqueName: \"kubernetes.io/projected/50cfcbeb-1963-489d-b561-f23a486390f7-kube-api-access-9hsn6\") pod \"authorino-c548b5d7d-mgbcz\" (UID: \"50cfcbeb-1963-489d-b561-f23a486390f7\") " pod="kuadrant-system/authorino-c548b5d7d-mgbcz"
Sep 06 12:26:01.164843 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.164770    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:01.196778 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.196756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hsn6\" (UniqueName: \"kubernetes.io/projected/50cfcbeb-1963-489d-b561-f23a486390f7-kube-api-access-9hsn6\") pod \"authorino-c548b5d7d-mgbcz\" (UID: \"50cfcbeb-1963-489d-b561-f23a486390f7\") " pod="kuadrant-system/authorino-c548b5d7d-mgbcz"
Sep 06 12:26:01.204937 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.204910    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hsn6\" (UniqueName: \"kubernetes.io/projected/50cfcbeb-1963-489d-b561-f23a486390f7-kube-api-access-9hsn6\") pod \"authorino-c548b5d7d-mgbcz\" (UID: \"50cfcbeb-1963-489d-b561-f23a486390f7\") " pod="kuadrant-system/authorino-c548b5d7d-mgbcz"
Sep 06 12:26:01.308481 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.308453    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-mgbcz"
Sep 06 12:26:01.574939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:01.574911    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-mgbcz"]
Sep 06 12:26:01.577716 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:26:01.577687    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50cfcbeb_1963_489d_b561_f23a486390f7.slice/crio-5b551e5a9f7bb1b9facd35a82341322d8f0d2c49a87956145f073b40aa48083c WatchSource:0}: Error finding container 5b551e5a9f7bb1b9facd35a82341322d8f0d2c49a87956145f073b40aa48083c: Status 404 returned error can't find the container with id 5b551e5a9f7bb1b9facd35a82341322d8f0d2c49a87956145f073b40aa48083c
Sep 06 12:26:02.391040 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:02.390982    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-mgbcz" event={"ID":"50cfcbeb-1963-489d-b561-f23a486390f7","Type":"ContainerStarted","Data":"5b551e5a9f7bb1b9facd35a82341322d8f0d2c49a87956145f073b40aa48083c"}
Sep 06 12:26:04.400833 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:04.400741    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-mgbcz" event={"ID":"50cfcbeb-1963-489d-b561-f23a486390f7","Type":"ContainerStarted","Data":"c36e4757ed4ffc62404e74fc59b55b58245aeae0e7096cb9195cf80d04c455cd"}
Sep 06 12:26:04.414731 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:04.414682    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-mgbcz" podStartSLOduration=2.006040014 podStartE2EDuration="4.414666883s" totalImagesPullingTime="2.408626869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:26:04.413379525 +0000 UTC m=+504.387426712" watchObservedRunningTime="2026-09-06 12:26:04.414666883 +0000 UTC m=+504.388714068"
Sep 06 12:26:16.429056 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:16.429021    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:16.529105 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:16.529077    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:16.862113 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:16.862081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:29.486666 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:29.486629    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:30.116978 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:30.116939    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:31.386983 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:31.386952    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-mgbcz"]
Sep 06 12:26:31.387401 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:31.387112    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-mgbcz" podUID="50cfcbeb-1963-489d-b561-f23a486390f7" containerName="authorino" containerID="cri-o://c36e4757ed4ffc62404e74fc59b55b58245aeae0e7096cb9195cf80d04c455cd" gracePeriod=30
Sep 06 12:26:31.511203 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:31.511177    2568 generic.go:356] "Generic (PLEG): container finished" podID="50cfcbeb-1963-489d-b561-f23a486390f7" containerID="c36e4757ed4ffc62404e74fc59b55b58245aeae0e7096cb9195cf80d04c455cd" exitCode=0
Sep 06 12:26:31.511295 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:31.511220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-mgbcz" event={"ID":"50cfcbeb-1963-489d-b561-f23a486390f7","Type":"ContainerDied","Data":"c36e4757ed4ffc62404e74fc59b55b58245aeae0e7096cb9195cf80d04c455cd"}
Sep 06 12:26:31.628969 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:31.628948    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-mgbcz"
Sep 06 12:26:31.707556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:31.707532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hsn6\" (UniqueName: \"kubernetes.io/projected/50cfcbeb-1963-489d-b561-f23a486390f7-kube-api-access-9hsn6\") pod \"50cfcbeb-1963-489d-b561-f23a486390f7\" (UID: \"50cfcbeb-1963-489d-b561-f23a486390f7\") "
Sep 06 12:26:31.709730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:31.709706    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50cfcbeb-1963-489d-b561-f23a486390f7-kube-api-access-9hsn6" (OuterVolumeSpecName: "kube-api-access-9hsn6") pod "50cfcbeb-1963-489d-b561-f23a486390f7" (UID: "50cfcbeb-1963-489d-b561-f23a486390f7"). InnerVolumeSpecName "kube-api-access-9hsn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:26:31.808986 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:31.808961    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hsn6\" (UniqueName: \"kubernetes.io/projected/50cfcbeb-1963-489d-b561-f23a486390f7-kube-api-access-9hsn6\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:26:32.520124 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:32.520091    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-mgbcz"
Sep 06 12:26:32.520531 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:32.520121    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-mgbcz" event={"ID":"50cfcbeb-1963-489d-b561-f23a486390f7","Type":"ContainerDied","Data":"5b551e5a9f7bb1b9facd35a82341322d8f0d2c49a87956145f073b40aa48083c"}
Sep 06 12:26:32.520531 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:32.520170    2568 scope.go:117] "RemoveContainer" containerID="c36e4757ed4ffc62404e74fc59b55b58245aeae0e7096cb9195cf80d04c455cd"
Sep 06 12:26:32.535645 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:32.535623    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-mgbcz"]
Sep 06 12:26:32.539460 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:32.539444    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-mgbcz"]
Sep 06 12:26:34.513955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:34.513925    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50cfcbeb-1963-489d-b561-f23a486390f7" path="/var/lib/kubelet/pods/50cfcbeb-1963-489d-b561-f23a486390f7/volumes"
Sep 06 12:26:35.903175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:35.903122    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:35.972702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:35.972676    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:36.027484 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:36.027453    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:36.306823 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:36.306796    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:36.407400 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:36.407368    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:39.987007 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:39.986954    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:26:40.086707 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:26:40.086680    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:12.269412 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:12.269379    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:12.369764 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:12.369726    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:12.575167 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:12.575106    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:12.718476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:12.718454    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:14.005423 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:14.005389    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:14.106997 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:14.106970    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:14.317240 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:14.317158    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:14.398729 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:14.398700    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:14.674623 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:14.674530    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:14.767311 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:14.767262    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:24.520833 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:24.520800    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:25.694789 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:25.694753    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:30.862891 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:30.862853    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:35.044870 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:35.044835    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:35.094544 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:35.094518    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:38.532281 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:38.532248    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:27:55.128912 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:27:55.128870    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:28:08.409633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.409532    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"]
Sep 06 12:28:08.410043 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.409846    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cfcbeb-1963-489d-b561-f23a486390f7" containerName="authorino"
Sep 06 12:28:08.410043 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.409858    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cfcbeb-1963-489d-b561-f23a486390f7" containerName="authorino"
Sep 06 12:28:08.410043 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.409908    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="50cfcbeb-1963-489d-b561-f23a486390f7" containerName="authorino"
Sep 06 12:28:08.412703 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.412680    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.414938 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.414918    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 12:28:08.415668 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.415650    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 06 12:28:08.415761 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.415692    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 12:28:08.415988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.415969    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rs9bv\""
Sep 06 12:28:08.423343 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.423325    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"]
Sep 06 12:28:08.434290 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.434270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn5tz\" (UniqueName: \"kubernetes.io/projected/a742cdf4-9102-4ba5-85a9-623191054f26-kube-api-access-kn5tz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.434390 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.434301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.434390 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.434323    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.434390 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.434355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.434513 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.434423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.434513 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.434469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a742cdf4-9102-4ba5-85a9-623191054f26-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.436665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.436631    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:28:08.535511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.535490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a742cdf4-9102-4ba5-85a9-623191054f26-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.535653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.535517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn5tz\" (UniqueName: \"kubernetes.io/projected/a742cdf4-9102-4ba5-85a9-623191054f26-kube-api-access-kn5tz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.535653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.535539    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.535653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.535558    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.535653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.535579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.535653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.535646    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.536029 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.536004    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.536121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.536027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.536121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.536050    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.538343 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.538321    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a742cdf4-9102-4ba5-85a9-623191054f26-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.538724 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.538706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a742cdf4-9102-4ba5-85a9-623191054f26-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.543186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.543166    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn5tz\" (UniqueName: \"kubernetes.io/projected/a742cdf4-9102-4ba5-85a9-623191054f26-kube-api-access-kn5tz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84\" (UID: \"a742cdf4-9102-4ba5-85a9-623191054f26\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.722856 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.722829    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:08.988372 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.988302    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"]
Sep 06 12:28:08.991190 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:28:08.991160    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda742cdf4_9102_4ba5_85a9_623191054f26.slice/crio-ce857bb367bc7ade5c21925acd1eb2f8d23d746b37a6d2cf90485a37b7d55bc3 WatchSource:0}: Error finding container ce857bb367bc7ade5c21925acd1eb2f8d23d746b37a6d2cf90485a37b7d55bc3: Status 404 returned error can't find the container with id ce857bb367bc7ade5c21925acd1eb2f8d23d746b37a6d2cf90485a37b7d55bc3
Sep 06 12:28:08.992398 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:08.992380    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:28:09.903320 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:09.903291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84" event={"ID":"a742cdf4-9102-4ba5-85a9-623191054f26","Type":"ContainerStarted","Data":"ce857bb367bc7ade5c21925acd1eb2f8d23d746b37a6d2cf90485a37b7d55bc3"}
Sep 06 12:28:10.908699 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:10.908661    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84" event={"ID":"a742cdf4-9102-4ba5-85a9-623191054f26","Type":"ContainerStarted","Data":"01e627a4ea74cf0d7f95b5e4db966ac1b0c14252a7df6cc5f8cb0389a55a2272"}
Sep 06 12:28:10.924766 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:10.924724    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84" podStartSLOduration=1.967396597 podStartE2EDuration="2.924709176s" totalImagesPullingTime="957.312579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:28:10.922762671 +0000 UTC m=+630.896809856" watchObservedRunningTime="2026-09-06 12:28:10.924709176 +0000 UTC m=+630.898756403"
Sep 06 12:28:18.723707 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:18.723679    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:18.724091 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:18.723739    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:18.735835 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:18.735814    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:18.951406 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:18.951381    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84"
Sep 06 12:28:22.501413 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.501381    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"]
Sep 06 12:28:22.505700 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.505681    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.507697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.507676    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 06 12:28:22.515177 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.515155    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"]
Sep 06 12:28:22.528555 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.528523    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:28:22.627988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.627965    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.628079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.627995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpbz7\" (UniqueName: \"kubernetes.io/projected/384ccc1c-be11-4902-ab85-bb54b287d13d-kube-api-access-mpbz7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.628079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.628018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.628152 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.628108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.628152 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.628143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.628217 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.628196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/384ccc1c-be11-4902-ab85-bb54b287d13d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.728525 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.728499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.728640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.728531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpbz7\" (UniqueName: \"kubernetes.io/projected/384ccc1c-be11-4902-ab85-bb54b287d13d-kube-api-access-mpbz7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.728640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.728557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.728640 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.728624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.728787 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.728663    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.728787 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.728708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/384ccc1c-be11-4902-ab85-bb54b287d13d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.728994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.728973    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.729057 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.729018    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.729057 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.729039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.730859 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.730835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/384ccc1c-be11-4902-ab85-bb54b287d13d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.731142 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.731126    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/384ccc1c-be11-4902-ab85-bb54b287d13d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.735792 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.735774    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpbz7\" (UniqueName: \"kubernetes.io/projected/384ccc1c-be11-4902-ab85-bb54b287d13d-kube-api-access-mpbz7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p6jpt\" (UID: \"384ccc1c-be11-4902-ab85-bb54b287d13d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:22.816511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:22.816458    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:23.084913 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:23.084889    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"]
Sep 06 12:28:23.086803 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:28:23.086766    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384ccc1c_be11_4902_ab85_bb54b287d13d.slice/crio-a83cfd4c4dc6ffc061bc7f85b50ff671a00f9c7ef98e446f52ada8a572f10c17 WatchSource:0}: Error finding container a83cfd4c4dc6ffc061bc7f85b50ff671a00f9c7ef98e446f52ada8a572f10c17: Status 404 returned error can't find the container with id a83cfd4c4dc6ffc061bc7f85b50ff671a00f9c7ef98e446f52ada8a572f10c17
Sep 06 12:28:23.962783 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:23.962750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt" event={"ID":"384ccc1c-be11-4902-ab85-bb54b287d13d","Type":"ContainerStarted","Data":"a4fa8be00997b25533003f729e4c8905c002757789f8fa4531444b4a93bfedd0"}
Sep 06 12:28:23.963112 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:23.962800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt" event={"ID":"384ccc1c-be11-4902-ab85-bb54b287d13d","Type":"ContainerStarted","Data":"a83cfd4c4dc6ffc061bc7f85b50ff671a00f9c7ef98e446f52ada8a572f10c17"}
Sep 06 12:28:23.980874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:23.980829    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt" podStartSLOduration=1.816083004 podStartE2EDuration="1.98081299s" totalImagesPullingTime="164.729986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:28:23.979729583 +0000 UTC m=+643.953776767" watchObservedRunningTime="2026-09-06 12:28:23.98081299 +0000 UTC m=+643.954860174"
Sep 06 12:28:32.816824 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:32.816787    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:32.817286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:32.816853    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:32.829484 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:32.829449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:33.011213 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:33.011185    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p6jpt"
Sep 06 12:28:37.089724 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.089686    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"]
Sep 06 12:28:37.093568 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.093548    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.096171 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.096152    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 06 12:28:37.101980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.101959    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"]
Sep 06 12:28:37.135257 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.135231    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.135359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.135279    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fwsw\" (UniqueName: \"kubernetes.io/projected/b3e09922-80c6-40fe-a945-48fa18b301a4-kube-api-access-4fwsw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.135359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.135311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.135359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.135336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e09922-80c6-40fe-a945-48fa18b301a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.135513 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.135383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.135513 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.135441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.136262 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.136236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:28:37.235917 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.235896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.236030 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.235923    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e09922-80c6-40fe-a945-48fa18b301a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.236030 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.235943    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.236030 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.235972    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.236030 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.236027    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.236241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.236070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fwsw\" (UniqueName: \"kubernetes.io/projected/b3e09922-80c6-40fe-a945-48fa18b301a4-kube-api-access-4fwsw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.236341 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.236317    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.236415 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.236398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.236480 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.236457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.238348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.238329    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3e09922-80c6-40fe-a945-48fa18b301a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.238495 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.238476    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e09922-80c6-40fe-a945-48fa18b301a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.243238 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.243215    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fwsw\" (UniqueName: \"kubernetes.io/projected/b3e09922-80c6-40fe-a945-48fa18b301a4-kube-api-access-4fwsw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q\" (UID: \"b3e09922-80c6-40fe-a945-48fa18b301a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.405696 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.405633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:37.675020 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:37.674991    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"]
Sep 06 12:28:37.677316 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:28:37.677286    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e09922_80c6_40fe_a945_48fa18b301a4.slice/crio-dfa8e56dc77dfc0fc9f2a5a7ec68f95bb6202cdca894e3cc886e56203d19623c WatchSource:0}: Error finding container dfa8e56dc77dfc0fc9f2a5a7ec68f95bb6202cdca894e3cc886e56203d19623c: Status 404 returned error can't find the container with id dfa8e56dc77dfc0fc9f2a5a7ec68f95bb6202cdca894e3cc886e56203d19623c
Sep 06 12:28:38.021508 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:38.021470    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q" event={"ID":"b3e09922-80c6-40fe-a945-48fa18b301a4","Type":"ContainerStarted","Data":"db07e35b03af29dfd1030520aca47f86241c10add7b8c90cc596378d4463d49a"}
Sep 06 12:28:38.021646 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:38.021530    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q" event={"ID":"b3e09922-80c6-40fe-a945-48fa18b301a4","Type":"ContainerStarted","Data":"dfa8e56dc77dfc0fc9f2a5a7ec68f95bb6202cdca894e3cc886e56203d19623c"}
Sep 06 12:28:38.036510 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:38.036463    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q" podStartSLOduration=0.869779896 podStartE2EDuration="1.036443719s" totalImagesPullingTime="166.663823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:28:38.035835929 +0000 UTC m=+658.009883115" watchObservedRunningTime="2026-09-06 12:28:38.036443719 +0000 UTC m=+658.010490905"
Sep 06 12:28:47.406409 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:47.406367    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:47.406927 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:47.406434    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:47.418811 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:47.418789    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:48.079695 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:48.079670    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q"
Sep 06 12:28:48.969047 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:48.969014    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:28:55.011725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:28:55.011697    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:29:04.505247 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.505216    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"]
Sep 06 12:29:04.508398 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.508379    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.510522 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.510497    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 06 12:29:04.517940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.517914    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"]
Sep 06 12:29:04.549040 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.548989    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:29:04.627880 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.627858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8c2710-d959-499e-b895-313e9d9ecabc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.627990 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.627894    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pcmd\" (UniqueName: \"kubernetes.io/projected/1c8c2710-d959-499e-b895-313e9d9ecabc-kube-api-access-2pcmd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.627990 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.627921    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.628068 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.627985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.628068 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.628007    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.628068 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.628026    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729196 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8c2710-d959-499e-b895-313e9d9ecabc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729299 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pcmd\" (UniqueName: \"kubernetes.io/projected/1c8c2710-d959-499e-b895-313e9d9ecabc-kube-api-access-2pcmd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729299 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729368 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729327    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729368 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729362    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729437 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729740 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729858 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729765    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.729858 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.729802    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.731621 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.731572    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c8c2710-d959-499e-b895-313e9d9ecabc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.731771 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.731750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8c2710-d959-499e-b895-313e9d9ecabc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.736054 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.736035    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pcmd\" (UniqueName: \"kubernetes.io/projected/1c8c2710-d959-499e-b895-313e9d9ecabc-kube-api-access-2pcmd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2\" (UID: \"1c8c2710-d959-499e-b895-313e9d9ecabc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:04.820539 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:04.820482    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:05.089465 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:05.089408    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"]
Sep 06 12:29:05.091567 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:29:05.091538    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c8c2710_d959_499e_b895_313e9d9ecabc.slice/crio-c73b572e84c01ca45dbe7aafb1c88567be5389ec91d98d0057c0067255d0c1c7 WatchSource:0}: Error finding container c73b572e84c01ca45dbe7aafb1c88567be5389ec91d98d0057c0067255d0c1c7: Status 404 returned error can't find the container with id c73b572e84c01ca45dbe7aafb1c88567be5389ec91d98d0057c0067255d0c1c7
Sep 06 12:29:05.137494 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:05.137458    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2" event={"ID":"1c8c2710-d959-499e-b895-313e9d9ecabc","Type":"ContainerStarted","Data":"c73b572e84c01ca45dbe7aafb1c88567be5389ec91d98d0057c0067255d0c1c7"}
Sep 06 12:29:06.143955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:06.143923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2" event={"ID":"1c8c2710-d959-499e-b895-313e9d9ecabc","Type":"ContainerStarted","Data":"ee1e27c9bbe3f9c21bbc8fe87877b652b679b1f1b020842ffe0e38b4a45e2885"}
Sep 06 12:29:06.159531 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:06.159458    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2" podStartSLOduration=1.997072603 podStartE2EDuration="2.159442279s" totalImagesPullingTime="162.369676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:29:06.159198724 +0000 UTC m=+686.133245902" watchObservedRunningTime="2026-09-06 12:29:06.159442279 +0000 UTC m=+686.133489463"
Sep 06 12:29:14.821051 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:14.821018    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:14.821433 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:14.821061    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:14.833166 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:14.833141    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:15.190199 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:15.190176    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2"
Sep 06 12:29:29.665509 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:29.665458    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:29:29.766288 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:29.766251    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:29:58.012030 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:58.011990    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:29:58.109874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:58.109841    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:29:59.089018 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:59.088989    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:29:59.185886 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:29:59.185857    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:14.271478 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:14.271441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:14.371567 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:14.371539    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:14.585533 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:14.585437    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:14.676822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:14.676796    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:15.604241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:15.604211    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:15.704274 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:15.704240    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:16.039651 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:16.039594    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:17.479467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:17.479424    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:17.621713 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:17.621676    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:18.653508 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:18.653466    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:18.758280 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:18.758253    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:18.853290 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:18.853258    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:19.136530 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:19.136496    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:19.235288 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:19.235256    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:21.834443 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:21.834411    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:21.935241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:21.935211    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:22.045695 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:22.045669    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:22.332672 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:22.332637    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:22.506390 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:22.506356    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:24.308787 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:24.308747    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:24.599987 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:24.599904    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:24.993864 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:24.993823    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:25.085074 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:25.085037    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:25.185226 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:25.185197    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:26.200403 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:26.200373    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:26.300907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:26.300872    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:26.400918 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:26.400883    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:26.663757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:26.663695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:26.769390 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:26.769357    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:27.690612 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:27.690564    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:27.792337 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:27.792278    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:28.850076 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:28.850044    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:28.946953 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:28.946925    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:29.000058 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.000030    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:29.337306 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.337279    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:29.408960 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.408937    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:29.431956 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.431937    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"]
Sep 06 12:30:29.435011 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.434996    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:29.436946 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.436928    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-0e6ab1\""
Sep 06 12:30:29.437039 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.436948    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-0e6ab1-dockercfg-pkdzb\""
Sep 06 12:30:29.445561 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.445542    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"]
Sep 06 12:30:29.470479 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.470454    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"]
Sep 06 12:30:29.473401 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.473388    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:29.484953 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.484929    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"]
Sep 06 12:30:29.518952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.518929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57\" (UID: \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:29.519051 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.518975    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlqxw\" (UniqueName: \"kubernetes.io/projected/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-kube-api-access-qlqxw\") pod \"payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57\" (UID: \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:29.519119 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.519062    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-plugins-config-volume\") pod \"payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549\" (UID: \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\") " pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:29.519119 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.519102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5bk5\" (UniqueName: \"kubernetes.io/projected/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-kube-api-access-q5bk5\") pod \"payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549\" (UID: \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\") " pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:29.619914 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.619852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-plugins-config-volume\") pod \"payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549\" (UID: \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\") " pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:29.619914 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.619892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5bk5\" (UniqueName: \"kubernetes.io/projected/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-kube-api-access-q5bk5\") pod \"payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549\" (UID: \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\") " pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:29.620048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.619915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57\" (UID: \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:29.620048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.619957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlqxw\" (UniqueName: \"kubernetes.io/projected/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-kube-api-access-qlqxw\") pod \"payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57\" (UID: \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:29.620499 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.620480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-plugins-config-volume\") pod \"payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549\" (UID: \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\") " pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:29.620644 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.620629    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57\" (UID: \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:29.628039 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.628012    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5bk5\" (UniqueName: \"kubernetes.io/projected/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-kube-api-access-q5bk5\") pod \"payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549\" (UID: \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\") " pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:29.628129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.628081    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlqxw\" (UniqueName: \"kubernetes.io/projected/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-kube-api-access-qlqxw\") pod \"payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57\" (UID: \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:29.744708 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.744685    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:29.781924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:29.781895    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:30.013334 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:30.013310    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"]
Sep 06 12:30:30.015795 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:30:30.015752    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ea7ed5_5d2f_4cbf_adab_16acd46684ef.slice/crio-2326787fd4ca8bf56aa729310c149ce0e44f494518e5a596dbc40b6914719178 WatchSource:0}: Error finding container 2326787fd4ca8bf56aa729310c149ce0e44f494518e5a596dbc40b6914719178: Status 404 returned error can't find the container with id 2326787fd4ca8bf56aa729310c149ce0e44f494518e5a596dbc40b6914719178
Sep 06 12:30:30.063136 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:30.060626    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"]
Sep 06 12:30:30.497576 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:30.497501    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549" event={"ID":"80fff7a2-3f4c-4f5b-9ce4-935b3218e487","Type":"ContainerStarted","Data":"cd774df42d44773840a238febde1da8d5939ee237a3d1566908317be95ff7fea"}
Sep 06 12:30:30.500648 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:30.500586    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57" event={"ID":"62ea7ed5-5d2f-4cbf-adab-16acd46684ef","Type":"ContainerStarted","Data":"2326787fd4ca8bf56aa729310c149ce0e44f494518e5a596dbc40b6914719178"}
Sep 06 12:30:32.514748 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.514717    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549" event={"ID":"80fff7a2-3f4c-4f5b-9ce4-935b3218e487","Type":"ContainerStarted","Data":"d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718"}
Sep 06 12:30:32.515091 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.514767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57" event={"ID":"62ea7ed5-5d2f-4cbf-adab-16acd46684ef","Type":"ContainerStarted","Data":"fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b"}
Sep 06 12:30:32.515091 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.514789    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:32.515091 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.514804    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:32.529239 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.529186    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549" podStartSLOduration=1.280054737 podStartE2EDuration="3.529169328s" totalImagesPullingTime="2.249114591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:32.527190317 +0000 UTC m=+772.501237502" watchObservedRunningTime="2026-09-06 12:30:32.529169328 +0000 UTC m=+772.503216508"
Sep 06 12:30:32.543793 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.543748    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57" podStartSLOduration=1.242245748 podStartE2EDuration="3.54373421s" totalImagesPullingTime="2.301488462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:32.541832338 +0000 UTC m=+772.515879523" watchObservedRunningTime="2026-09-06 12:30:32.54373421 +0000 UTC m=+772.517781396"
Sep 06 12:30:32.723311 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.723282    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:32.880868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.880836    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:32.973917 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:32.973851    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:33.074741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:33.074718    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:35.706321 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:35.706283    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:37.302348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:37.302315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:39.389756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:39.389721    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:39.475662 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:39.475630    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:39.541317 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:39.541276    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:39.646017 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:39.645955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:42.371455 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:42.371407    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:42.676118 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:42.676039    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:43.015137 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.015101    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"]
Sep 06 12:30:43.018442 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.018421    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.020544 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.020524    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-58053a-openshift-default-dockercfg-78wcq\""
Sep 06 12:30:43.028368 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.028343    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"]
Sep 06 12:30:43.041011 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.040985    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:43.135253 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fc35c6-a581-4307-9568-82d3255d9c74-istiod-ca-cert\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.135379 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135258    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-credential-socket\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.135379 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-certs\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.135379 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135325    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fc35c6-a581-4307-9568-82d3255d9c74-istio-podinfo\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.135478 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135426    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-data\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.135510 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-envoy\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.135543 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135513    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-istio-token\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.135577 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-socket\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.135577 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.135563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c54l\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-kube-api-access-9c54l\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.235929 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.235903    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-data\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236031 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.235946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-envoy\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236031 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.235964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-istio-token\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236087    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-socket\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236190 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c54l\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-kube-api-access-9c54l\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236190 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236181    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fc35c6-a581-4307-9568-82d3255d9c74-istiod-ca-cert\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236211    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-credential-socket\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-certs\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fc35c6-a581-4307-9568-82d3255d9c74-istio-podinfo\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236426 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-data\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236426 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236387    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-socket\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236627 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236570    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-credential-socket\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236836 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236813    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-certs\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.236987 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.236968    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fc35c6-a581-4307-9568-82d3255d9c74-istiod-ca-cert\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.238311 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.238286    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-envoy\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.238784 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.238766    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fc35c6-a581-4307-9568-82d3255d9c74-istio-podinfo\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.244637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.244612    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-istio-token\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.244736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.244712    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c54l\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-kube-api-access-9c54l\") pod \"e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") " pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.274475 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.274420    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:43.332339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.332319    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:43.519818 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.519790    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:30:43.520206 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.519901    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:30:43.603514 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.603490    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"]
Sep 06 12:30:43.605925 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:30:43.605896    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fc35c6_a581_4307_9568_82d3255d9c74.slice/crio-8a53e1f350cf225ba880cf29b00cda2c1599b1ab562392d55cc995be8800d948 WatchSource:0}: Error finding container 8a53e1f350cf225ba880cf29b00cda2c1599b1ab562392d55cc995be8800d948: Status 404 returned error can't find the container with id 8a53e1f350cf225ba880cf29b00cda2c1599b1ab562392d55cc995be8800d948
Sep 06 12:30:43.608163 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.608126    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:30:43.608255 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.608204    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:30:43.608255 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:43.608248    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:30:44.565642 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:44.565584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" event={"ID":"51fc35c6-a581-4307-9568-82d3255d9c74","Type":"ContainerStarted","Data":"c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65"}
Sep 06 12:30:44.566000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:44.565660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" event={"ID":"51fc35c6-a581-4307-9568-82d3255d9c74","Type":"ContainerStarted","Data":"8a53e1f350cf225ba880cf29b00cda2c1599b1ab562392d55cc995be8800d948"}
Sep 06 12:30:44.585387 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:44.585323    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" podStartSLOduration=2.585308919 podStartE2EDuration="2.585308919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:44.584300319 +0000 UTC m=+784.558347528" watchObservedRunningTime="2026-09-06 12:30:44.585308919 +0000 UTC m=+784.559356145"
Sep 06 12:30:45.263867 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.263827    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:45.326009 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.325983    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:45.332812 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.332792    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:45.337461 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.337442    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:45.402144 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.402120    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:45.497209 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.497177    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:45.570700 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.570652    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:45.571588 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.571570    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:30:45.629822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:45.629791    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:46.633528 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:46.633494    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:46.779337 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:46.779285    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:47.199287 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:47.199252    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:47.977497 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:47.977460    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:48.032127 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.032102    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:48.238391 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.238313    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:48.450292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.450260    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:48.549503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.549408    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:48.555930 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.555891    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"]
Sep 06 12:30:48.559919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.559902    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:48.561994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.561971    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-58053a\""
Sep 06 12:30:48.561994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.561981    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-58053a-dockercfg-85qbz\""
Sep 06 12:30:48.569693 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.569667    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"]
Sep 06 12:30:48.592267 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.592240    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"]
Sep 06 12:30:48.596226 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.596206    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:48.605044 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.605022    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"]
Sep 06 12:30:48.679773 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.679742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/7803468e-8914-4ece-965f-9e65ce325661-kube-api-access-xbskc\") pod \"payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s\" (UID: \"7803468e-8914-4ece-965f-9e65ce325661\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:48.679937 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.679832    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7803468e-8914-4ece-965f-9e65ce325661-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s\" (UID: \"7803468e-8914-4ece-965f-9e65ce325661\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:48.781195 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.781168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/7803468e-8914-4ece-965f-9e65ce325661-kube-api-access-xbskc\") pod \"payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s\" (UID: \"7803468e-8914-4ece-965f-9e65ce325661\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:48.781318 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.781210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f4e9a6e-87b5-4639-a604-24e9a0b024be-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59\" (UID: \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\") " pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:48.781318 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.781242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7803468e-8914-4ece-965f-9e65ce325661-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s\" (UID: \"7803468e-8914-4ece-965f-9e65ce325661\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:48.781318 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.781260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t25v\" (UniqueName: \"kubernetes.io/projected/1f4e9a6e-87b5-4639-a604-24e9a0b024be-kube-api-access-6t25v\") pod \"payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59\" (UID: \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\") " pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:48.782003 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.781978    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7803468e-8914-4ece-965f-9e65ce325661-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s\" (UID: \"7803468e-8914-4ece-965f-9e65ce325661\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:48.788667 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.788637    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/7803468e-8914-4ece-965f-9e65ce325661-kube-api-access-xbskc\") pod \"payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s\" (UID: \"7803468e-8914-4ece-965f-9e65ce325661\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:48.827573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.827518    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:48.873040 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.873019    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:48.882139 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.882120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f4e9a6e-87b5-4639-a604-24e9a0b024be-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59\" (UID: \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\") " pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:48.882202 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.882160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t25v\" (UniqueName: \"kubernetes.io/projected/1f4e9a6e-87b5-4639-a604-24e9a0b024be-kube-api-access-6t25v\") pod \"payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59\" (UID: \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\") " pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:48.882919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.882901    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f4e9a6e-87b5-4639-a604-24e9a0b024be-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59\" (UID: \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\") " pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:48.895327 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.895307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t25v\" (UniqueName: \"kubernetes.io/projected/1f4e9a6e-87b5-4639-a604-24e9a0b024be-kube-api-access-6t25v\") pod \"payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59\" (UID: \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\") " pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:48.907487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:48.907466    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:49.148187 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.148126    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"]
Sep 06 12:30:49.151162 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:30:49.151135    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7803468e_8914_4ece_965f_9e65ce325661.slice/crio-1c6ea2227a6ccbb0b068d79c09c12bf06017f9280a000fba3b902fcf3cab8d9e WatchSource:0}: Error finding container 1c6ea2227a6ccbb0b068d79c09c12bf06017f9280a000fba3b902fcf3cab8d9e: Status 404 returned error can't find the container with id 1c6ea2227a6ccbb0b068d79c09c12bf06017f9280a000fba3b902fcf3cab8d9e
Sep 06 12:30:49.182882 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.182860    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"]
Sep 06 12:30:49.186183 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:30:49.186163    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4e9a6e_87b5_4639_a604_24e9a0b024be.slice/crio-53c7e0e9c19fa0e784b618dcbe80fb7013792f50db734c0b999764c28e455b60 WatchSource:0}: Error finding container 53c7e0e9c19fa0e784b618dcbe80fb7013792f50db734c0b999764c28e455b60: Status 404 returned error can't find the container with id 53c7e0e9c19fa0e784b618dcbe80fb7013792f50db734c0b999764c28e455b60
Sep 06 12:30:49.572587 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.572555    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:49.591831 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.591795    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s" event={"ID":"7803468e-8914-4ece-965f-9e65ce325661","Type":"ContainerStarted","Data":"b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1"}
Sep 06 12:30:49.591976 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.591848    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s" event={"ID":"7803468e-8914-4ece-965f-9e65ce325661","Type":"ContainerStarted","Data":"1c6ea2227a6ccbb0b068d79c09c12bf06017f9280a000fba3b902fcf3cab8d9e"}
Sep 06 12:30:49.591976 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.591895    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:30:49.593454 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.593431    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59" event={"ID":"1f4e9a6e-87b5-4639-a604-24e9a0b024be","Type":"ContainerStarted","Data":"ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517"}
Sep 06 12:30:49.593581 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.593481    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59" event={"ID":"1f4e9a6e-87b5-4639-a604-24e9a0b024be","Type":"ContainerStarted","Data":"53c7e0e9c19fa0e784b618dcbe80fb7013792f50db734c0b999764c28e455b60"}
Sep 06 12:30:49.593581 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.593561    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:30:49.608169 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.608132    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s" podStartSLOduration=1.608117203 podStartE2EDuration="1.608117203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:49.607341585 +0000 UTC m=+789.581388772" watchObservedRunningTime="2026-09-06 12:30:49.608117203 +0000 UTC m=+789.582164389"
Sep 06 12:30:49.622226 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:49.622179    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59" podStartSLOduration=1.622162079 podStartE2EDuration="1.622162079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:49.620733215 +0000 UTC m=+789.594780399" watchObservedRunningTime="2026-09-06 12:30:49.622162079 +0000 UTC m=+789.596209266"
Sep 06 12:30:50.371273 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:50.371243    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:51.072999 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:51.072961    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:51.800299 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:51.800261    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:51.903845 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:51.903796    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:52.003761 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:52.003720    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:52.500155 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:52.500112    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:56.374959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:56.374918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:56.932262 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:56.932225    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:57.032310 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:57.032267    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:57.126882 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:57.126838    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:57.188292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:57.188267    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:57.275214 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:57.275182    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:57.715175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:57.715142    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:57.839741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:57.839702    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:57.926806 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:57.926778    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:58.235324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:58.235290    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:30:58.448670 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:30:58.448640    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:00.604764 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:00.604730    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:31:00.605218 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:00.604941    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:31:00.715792 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:00.715758    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:00.801396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:00.801358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:00.876009 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:00.875912    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:00.934447 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:00.934418    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:01.047176 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.047147    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:01.371991 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.371952    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:01.529042 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.528945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:01.698465 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.693719    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"]
Sep 06 12:31:01.699333 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.699309    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:01.702513 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.701740    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-924ef9c2\""
Sep 06 12:31:01.702513 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.702254    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-924ef9c2-dockercfg-qcnst\""
Sep 06 12:31:01.703309 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.703287    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"]
Sep 06 12:31:01.800456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.800418    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9f5x\" (UniqueName: \"kubernetes.io/projected/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-kube-api-access-l9f5x\") pod \"payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz\" (UID: \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\") " pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:01.800631 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.800492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-plugins-config-volume\") pod \"payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz\" (UID: \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\") " pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:01.901343 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.901305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9f5x\" (UniqueName: \"kubernetes.io/projected/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-kube-api-access-l9f5x\") pod \"payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz\" (UID: \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\") " pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:01.901532 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.901355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-plugins-config-volume\") pod \"payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz\" (UID: \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\") " pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:01.902037 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.902017    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-plugins-config-volume\") pod \"payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz\" (UID: \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\") " pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:01.908717 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:01.908686    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9f5x\" (UniqueName: \"kubernetes.io/projected/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-kube-api-access-l9f5x\") pod \"payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz\" (UID: \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\") " pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:02.013701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:02.013615    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:02.285380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:02.285355    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"]
Sep 06 12:31:02.287787 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:31:02.287753    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a7cdaf_f7ec_4951_98a4_7d3cf19ff5ff.slice/crio-97e8ff75615fdb885c3b7eba6a0fa7b208d66ec0993de3e39edfe4a857e23b08 WatchSource:0}: Error finding container 97e8ff75615fdb885c3b7eba6a0fa7b208d66ec0993de3e39edfe4a857e23b08: Status 404 returned error can't find the container with id 97e8ff75615fdb885c3b7eba6a0fa7b208d66ec0993de3e39edfe4a857e23b08
Sep 06 12:31:02.662316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:02.662237    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz" event={"ID":"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff","Type":"ContainerStarted","Data":"c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97"}
Sep 06 12:31:02.662316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:02.662287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz" event={"ID":"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff","Type":"ContainerStarted","Data":"97e8ff75615fdb885c3b7eba6a0fa7b208d66ec0993de3e39edfe4a857e23b08"}
Sep 06 12:31:02.662503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:02.662332    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:02.678886 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:02.678835    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz" podStartSLOduration=1.67881568 podStartE2EDuration="1.67881568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:31:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:31:02.676954875 +0000 UTC m=+802.651002061" watchObservedRunningTime="2026-09-06 12:31:02.67881568 +0000 UTC m=+802.652862869"
Sep 06 12:31:04.672315 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:04.672287    2568 generic.go:356] "Generic (PLEG): container finished" podID="51fc35c6-a581-4307-9568-82d3255d9c74" containerID="c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65" exitCode=0
Sep 06 12:31:04.672714 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:04.672372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" event={"ID":"51fc35c6-a581-4307-9568-82d3255d9c74","Type":"ContainerDied","Data":"c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65"}
Sep 06 12:31:04.672714 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:04.672701    2568 scope.go:117] "RemoveContainer" containerID="c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65"
Sep 06 12:31:04.673688 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:04.673662    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:31:04.673794 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:04.673742    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:31:04.673859 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:04.673790    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:31:05.681753 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:05.681720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" event={"ID":"51fc35c6-a581-4307-9568-82d3255d9c74","Type":"ContainerStarted","Data":"7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506"}
Sep 06 12:31:06.333190 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:06.333153    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:31:06.333417 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:06.333394    2568 patch_prober.go:28] interesting pod/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 06 12:31:06.333467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:06.333449    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 06 12:31:07.332778 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:07.332739    2568 patch_prober.go:28] interesting pod/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 06 12:31:07.333263 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:07.332806    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 06 12:31:08.333133 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:08.333094    2568 patch_prober.go:28] interesting pod/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 06 12:31:08.333560 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:08.333147    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 06 12:31:08.852468 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:08.852429    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:09.332949 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:09.332914    2568 patch_prober.go:28] interesting pod/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 06 12:31:09.333120 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:09.332973    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 06 12:31:10.333408 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:10.333374    2568 patch_prober.go:28] interesting pod/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 06 12:31:10.333813 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:10.333427    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 06 12:31:11.336641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:11.336592    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:31:11.337042 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:11.336882    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:31:11.337540 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:11.337517    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:31:11.452188 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:11.452153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:13.668616 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:13.668567    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:22.819248 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:22.819213    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:31.442173 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.442132    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:31.471900 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.471874    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"]
Sep 06 12:31:31.472141 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.472115    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz" podUID="76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff" containerName="payload-processing" containerID="cri-o://c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97" gracePeriod=30
Sep 06 12:31:31.509078 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.509054    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:31.602991 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.602960    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:31.659420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.659383    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:31.711566 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.711547    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:31.797254 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.797226    2568 generic.go:356] "Generic (PLEG): container finished" podID="76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff" containerID="c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97" exitCode=0
Sep 06 12:31:31.797435 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.797272    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz" event={"ID":"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff","Type":"ContainerDied","Data":"c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97"}
Sep 06 12:31:31.797435 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.797276    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"
Sep 06 12:31:31.797435 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.797313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz" event={"ID":"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff","Type":"ContainerDied","Data":"97e8ff75615fdb885c3b7eba6a0fa7b208d66ec0993de3e39edfe4a857e23b08"}
Sep 06 12:31:31.797435 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.797337    2568 scope.go:117] "RemoveContainer" containerID="c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97"
Sep 06 12:31:31.805938 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.805916    2568 scope.go:117] "RemoveContainer" containerID="c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97"
Sep 06 12:31:31.806245 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:31:31.806211    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97\": container with ID starting with c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97 not found: ID does not exist" containerID="c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97"
Sep 06 12:31:31.806289 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.806253    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97"} err="failed to get container status \"c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97\": rpc error: code = NotFound desc = could not find container \"c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97\": container with ID starting with c3989835aee2f1f9479944fe55b7c45e74a92f352a092e14665ac1a49b31fa97 not found: ID does not exist"
Sep 06 12:31:31.840166 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.840141    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-plugins-config-volume\") pod \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\" (UID: \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\") "
Sep 06 12:31:31.840271 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.840202    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9f5x\" (UniqueName: \"kubernetes.io/projected/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-kube-api-access-l9f5x\") pod \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\" (UID: \"76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff\") "
Sep 06 12:31:31.840487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.840465    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff" (UID: "76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:31:31.842309 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.842291    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-kube-api-access-l9f5x" (OuterVolumeSpecName: "kube-api-access-l9f5x") pod "76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff" (UID: "76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff"). InnerVolumeSpecName "kube-api-access-l9f5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:31:31.865837 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.865805    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:31.941997 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.941967    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:31:31.941997 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:31.941995    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9f5x\" (UniqueName: \"kubernetes.io/projected/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff-kube-api-access-l9f5x\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:31:32.117470 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:32.117446    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"]
Sep 06 12:31:32.121079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:32.121061    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-924ef9c2-76649f4b66-fkpdz"]
Sep 06 12:31:32.215216 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:32.215191    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:32.495377 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:32.495351    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:32.515352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:32.515322    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff" path="/var/lib/kubelet/pods/76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff/volumes"
Sep 06 12:31:32.907719 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:32.907627    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:34.552221 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:34.552192    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:34.647084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:34.647057    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:35.689511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:35.689464    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:35.790234 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:35.790193    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:35.889740 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:35.889711    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:36.279930 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.279895    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:36.391418 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.391384    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:36.577354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.577282    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"]
Sep 06 12:31:36.577667 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.577654    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff" containerName="payload-processing"
Sep 06 12:31:36.577708 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.577670    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff" containerName="payload-processing"
Sep 06 12:31:36.577754 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.577744    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a7cdaf-f7ec-4951-98a4-7d3cf19ff5ff" containerName="payload-processing"
Sep 06 12:31:36.580719 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.580704    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:36.582580 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.582525    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c85cb5d0-dockercfg-rpv5d\""
Sep 06 12:31:36.582743 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.582730    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c85cb5d0\""
Sep 06 12:31:36.590591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.590568    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"]
Sep 06 12:31:36.680877 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.680847    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvz5r\" (UniqueName: \"kubernetes.io/projected/e57eb4de-8126-499d-988f-c2f3a654251f-kube-api-access-pvz5r\") pod \"payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n\" (UID: \"e57eb4de-8126-499d-988f-c2f3a654251f\") " pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:36.680999 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.680896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57eb4de-8126-499d-988f-c2f3a654251f-plugins-config-volume\") pod \"payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n\" (UID: \"e57eb4de-8126-499d-988f-c2f3a654251f\") " pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:36.781752 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.781721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvz5r\" (UniqueName: \"kubernetes.io/projected/e57eb4de-8126-499d-988f-c2f3a654251f-kube-api-access-pvz5r\") pod \"payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n\" (UID: \"e57eb4de-8126-499d-988f-c2f3a654251f\") " pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:36.781752 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.781754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57eb4de-8126-499d-988f-c2f3a654251f-plugins-config-volume\") pod \"payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n\" (UID: \"e57eb4de-8126-499d-988f-c2f3a654251f\") " pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:36.782365 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.782348    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57eb4de-8126-499d-988f-c2f3a654251f-plugins-config-volume\") pod \"payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n\" (UID: \"e57eb4de-8126-499d-988f-c2f3a654251f\") " pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:36.789925 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.789902    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvz5r\" (UniqueName: \"kubernetes.io/projected/e57eb4de-8126-499d-988f-c2f3a654251f-kube-api-access-pvz5r\") pod \"payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n\" (UID: \"e57eb4de-8126-499d-988f-c2f3a654251f\") " pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:36.890503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:36.890440    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:37.158440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:37.158361    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"]
Sep 06 12:31:37.161696 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:31:37.161671    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57eb4de_8126_499d_988f_c2f3a654251f.slice/crio-3536dd1615cca6e3411ed8edbc7c904431eab2361eae295f090c2dc3aa637842 WatchSource:0}: Error finding container 3536dd1615cca6e3411ed8edbc7c904431eab2361eae295f090c2dc3aa637842: Status 404 returned error can't find the container with id 3536dd1615cca6e3411ed8edbc7c904431eab2361eae295f090c2dc3aa637842
Sep 06 12:31:37.826878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:37.826837    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n" event={"ID":"e57eb4de-8126-499d-988f-c2f3a654251f","Type":"ContainerStarted","Data":"6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4"}
Sep 06 12:31:37.827227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:37.826894    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n" event={"ID":"e57eb4de-8126-499d-988f-c2f3a654251f","Type":"ContainerStarted","Data":"3536dd1615cca6e3411ed8edbc7c904431eab2361eae295f090c2dc3aa637842"}
Sep 06 12:31:37.827227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:37.826951    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:37.842727 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:37.842683    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n" podStartSLOduration=1.8426689010000001 podStartE2EDuration="1.842668901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:31:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:31:37.841477774 +0000 UTC m=+837.815524961" watchObservedRunningTime="2026-09-06 12:31:37.842668901 +0000 UTC m=+837.816716086"
Sep 06 12:31:39.591658 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:39.591630    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:48.833396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:48.833368    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:31:56.228038 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.228000    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"]
Sep 06 12:31:56.233930 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.233905    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.236510 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.236487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-0e6ab1\"/\"autores-model-0e6ab1-kserve-self-signed-certs\""
Sep 06 12:31:56.236701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.236676    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-0e6ab1\"/\"kube-root-ca.crt\""
Sep 06 12:31:56.236822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.236635    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-0e6ab1\"/\"default-dockercfg-9t895\""
Sep 06 12:31:56.236899 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.236537    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-0e6ab1\"/\"openshift-service-ca.crt\""
Sep 06 12:31:56.238090 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.238060    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"]
Sep 06 12:31:56.332737 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.332712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-dshm\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.332844 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.332753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-tmp-dir\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.332844 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.332770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx2wv\" (UniqueName: \"kubernetes.io/projected/8567c9a7-8717-47b2-b457-e755a00eec56-kube-api-access-kx2wv\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.332964 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.332862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8567c9a7-8717-47b2-b457-e755a00eec56-tls-certs\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.332964 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.332904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-home\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.333061 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.332966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-model-cache\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433424 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-home\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433541 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-model-cache\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433541 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-dshm\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-tmp-dir\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx2wv\" (UniqueName: \"kubernetes.io/projected/8567c9a7-8717-47b2-b457-e755a00eec56-kube-api-access-kx2wv\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433650    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8567c9a7-8717-47b2-b457-e755a00eec56-tls-certs\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433852 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433826    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-home\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433911 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433887    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-tmp-dir\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.433978 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.433925    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-model-cache\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.435860 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.435831    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-dshm\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.436167 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.436151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8567c9a7-8717-47b2-b457-e755a00eec56-tls-certs\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.442094 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.442075    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx2wv\" (UniqueName: \"kubernetes.io/projected/8567c9a7-8717-47b2-b457-e755a00eec56-kube-api-access-kx2wv\") pod \"autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") " pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.544542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.544493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:31:56.698141 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.698031    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:31:56.815537 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.815514    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"]
Sep 06 12:31:56.817775 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:31:56.817745    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8567c9a7_8717_47b2_b457_e755a00eec56.slice/crio-12d4bf2e7945186f50993abec41932240e3a768e0a2575025cc820217fba39ae WatchSource:0}: Error finding container 12d4bf2e7945186f50993abec41932240e3a768e0a2575025cc820217fba39ae: Status 404 returned error can't find the container with id 12d4bf2e7945186f50993abec41932240e3a768e0a2575025cc820217fba39ae
Sep 06 12:31:56.914527 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.914496    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5" event={"ID":"8567c9a7-8717-47b2-b457-e755a00eec56","Type":"ContainerStarted","Data":"a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d"}
Sep 06 12:31:56.914660 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.914539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5" event={"ID":"8567c9a7-8717-47b2-b457-e755a00eec56","Type":"ContainerStarted","Data":"12d4bf2e7945186f50993abec41932240e3a768e0a2575025cc820217fba39ae"}
Sep 06 12:31:56.930226 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:31:56.930186    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5" podStartSLOduration=0.930172201 podStartE2EDuration="930.172201ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:31:56.928031166 +0000 UTC m=+856.902078352" watchObservedRunningTime="2026-09-06 12:31:56.930172201 +0000 UTC m=+856.904219386"
Sep 06 12:32:06.154336 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.154299    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:06.182881 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.182852    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"]
Sep 06 12:32:06.183138 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.183093    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n" podUID="e57eb4de-8126-499d-988f-c2f3a654251f" containerName="payload-processing" containerID="cri-o://6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4" gracePeriod=30
Sep 06 12:32:06.255443 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.255410    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:06.338015 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.337965    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:06.390440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.390409    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:06.436660 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.436636    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:32:06.511207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.511179    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvz5r\" (UniqueName: \"kubernetes.io/projected/e57eb4de-8126-499d-988f-c2f3a654251f-kube-api-access-pvz5r\") pod \"e57eb4de-8126-499d-988f-c2f3a654251f\" (UID: \"e57eb4de-8126-499d-988f-c2f3a654251f\") "
Sep 06 12:32:06.511364 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.511219    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57eb4de-8126-499d-988f-c2f3a654251f-plugins-config-volume\") pod \"e57eb4de-8126-499d-988f-c2f3a654251f\" (UID: \"e57eb4de-8126-499d-988f-c2f3a654251f\") "
Sep 06 12:32:06.511622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.511577    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57eb4de-8126-499d-988f-c2f3a654251f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e57eb4de-8126-499d-988f-c2f3a654251f" (UID: "e57eb4de-8126-499d-988f-c2f3a654251f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:06.513455 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.513429    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57eb4de-8126-499d-988f-c2f3a654251f-kube-api-access-pvz5r" (OuterVolumeSpecName: "kube-api-access-pvz5r") pod "e57eb4de-8126-499d-988f-c2f3a654251f" (UID: "e57eb4de-8126-499d-988f-c2f3a654251f"). InnerVolumeSpecName "kube-api-access-pvz5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:32:06.545559 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.545539    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:32:06.545677 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.545586    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:32:06.557573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.557548    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:32:06.612533 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.612504    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvz5r\" (UniqueName: \"kubernetes.io/projected/e57eb4de-8126-499d-988f-c2f3a654251f-kube-api-access-pvz5r\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:32:06.612533 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.612531    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57eb4de-8126-499d-988f-c2f3a654251f-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:32:06.960584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.960558    2568 generic.go:356] "Generic (PLEG): container finished" podID="e57eb4de-8126-499d-988f-c2f3a654251f" containerID="6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4" exitCode=0
Sep 06 12:32:06.960690 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.960632    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"
Sep 06 12:32:06.960690 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.960643    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n" event={"ID":"e57eb4de-8126-499d-988f-c2f3a654251f","Type":"ContainerDied","Data":"6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4"}
Sep 06 12:32:06.960761 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.960698    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n" event={"ID":"e57eb4de-8126-499d-988f-c2f3a654251f","Type":"ContainerDied","Data":"3536dd1615cca6e3411ed8edbc7c904431eab2361eae295f090c2dc3aa637842"}
Sep 06 12:32:06.960761 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.960723    2568 scope.go:117] "RemoveContainer" containerID="6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4"
Sep 06 12:32:06.969373 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.969354    2568 scope.go:117] "RemoveContainer" containerID="6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4"
Sep 06 12:32:06.969704 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:32:06.969673    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4\": container with ID starting with 6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4 not found: ID does not exist" containerID="6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4"
Sep 06 12:32:06.969794 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.969702    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4"} err="failed to get container status \"6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4\": rpc error: code = NotFound desc = could not find container \"6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4\": container with ID starting with 6ab07f54a98ed0f7cbe139b1c0036958b44010c3151d4eed45c02ca84093a5c4 not found: ID does not exist"
Sep 06 12:32:06.972882 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.972867    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:32:06.975747 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.975726    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"]
Sep 06 12:32:06.979094 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:06.979076    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c85cb5d0-6ffbf5948c-pc78n"]
Sep 06 12:32:07.404982 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:07.404880    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:07.837044 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:07.837013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:08.144495 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:08.144413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:08.374692 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:08.374655    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:08.515634 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:08.515582    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57eb4de-8126-499d-988f-c2f3a654251f" path="/var/lib/kubelet/pods/e57eb4de-8126-499d-988f-c2f3a654251f/volumes"
Sep 06 12:32:10.821665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:10.821633    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:10.910650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:10.910616    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:12.095001 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.094958    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:12.197187 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.197156    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:12.551001 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.550970    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:12.644918 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.644890    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:12.686879 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.686851    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"]
Sep 06 12:32:12.687182 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.687170    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57eb4de-8126-499d-988f-c2f3a654251f" containerName="payload-processing"
Sep 06 12:32:12.687221 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.687184    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57eb4de-8126-499d-988f-c2f3a654251f" containerName="payload-processing"
Sep 06 12:32:12.687267 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.687259    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57eb4de-8126-499d-988f-c2f3a654251f" containerName="payload-processing"
Sep 06 12:32:12.691461 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.691446    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:12.693446 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.693428    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-ff8cf183\""
Sep 06 12:32:12.693561 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.693540    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-ff8cf183-dockercfg-g4ml8\""
Sep 06 12:32:12.699944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.699922    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"]
Sep 06 12:32:12.760757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.760726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0be236cb-0485-46ae-967d-9260d0ae5282-plugins-config-volume\") pod \"payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z\" (UID: \"0be236cb-0485-46ae-967d-9260d0ae5282\") " pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:12.760909 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.760793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2xfw\" (UniqueName: \"kubernetes.io/projected/0be236cb-0485-46ae-967d-9260d0ae5282-kube-api-access-z2xfw\") pod \"payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z\" (UID: \"0be236cb-0485-46ae-967d-9260d0ae5282\") " pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:12.862266 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.862201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0be236cb-0485-46ae-967d-9260d0ae5282-plugins-config-volume\") pod \"payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z\" (UID: \"0be236cb-0485-46ae-967d-9260d0ae5282\") " pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:12.862266 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.862244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2xfw\" (UniqueName: \"kubernetes.io/projected/0be236cb-0485-46ae-967d-9260d0ae5282-kube-api-access-z2xfw\") pod \"payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z\" (UID: \"0be236cb-0485-46ae-967d-9260d0ae5282\") " pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:12.862884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.862865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0be236cb-0485-46ae-967d-9260d0ae5282-plugins-config-volume\") pod \"payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z\" (UID: \"0be236cb-0485-46ae-967d-9260d0ae5282\") " pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:12.869407 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:12.869386    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2xfw\" (UniqueName: \"kubernetes.io/projected/0be236cb-0485-46ae-967d-9260d0ae5282-kube-api-access-z2xfw\") pod \"payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z\" (UID: \"0be236cb-0485-46ae-967d-9260d0ae5282\") " pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:13.003174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:13.003142    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:13.285628 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:13.285587    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"]
Sep 06 12:32:13.287277 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:32:13.287253    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be236cb_0485_46ae_967d_9260d0ae5282.slice/crio-95dafe55347cba2afa418971fb7ecd16802a27ff7087c270ca699140dc247de9 WatchSource:0}: Error finding container 95dafe55347cba2afa418971fb7ecd16802a27ff7087c270ca699140dc247de9: Status 404 returned error can't find the container with id 95dafe55347cba2afa418971fb7ecd16802a27ff7087c270ca699140dc247de9
Sep 06 12:32:13.995128 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:13.995097    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z" event={"ID":"0be236cb-0485-46ae-967d-9260d0ae5282","Type":"ContainerStarted","Data":"0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867"}
Sep 06 12:32:13.995297 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:13.995143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z" event={"ID":"0be236cb-0485-46ae-967d-9260d0ae5282","Type":"ContainerStarted","Data":"95dafe55347cba2afa418971fb7ecd16802a27ff7087c270ca699140dc247de9"}
Sep 06 12:32:13.995297 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:13.995172    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:14.013691 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:14.013647    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z" podStartSLOduration=2.013632519 podStartE2EDuration="2.013632519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:32:14.01302495 +0000 UTC m=+873.987072135" watchObservedRunningTime="2026-09-06 12:32:14.013632519 +0000 UTC m=+873.987679703"
Sep 06 12:32:25.001992 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:25.001961    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:31.744092 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:31.744005    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:31.916740 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:31.916712    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"]
Sep 06 12:32:31.920650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:31.920633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:31.923514 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:31.923492    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-36bcab\"/\"openshift-service-ca.crt\""
Sep 06 12:32:31.923637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:31.923495    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-36bcab\"/\"default-dockercfg-pgrfm\""
Sep 06 12:32:31.923637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:31.923495    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-36bcab\"/\"test-model-36bcab-kserve-self-signed-certs\""
Sep 06 12:32:31.923637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:31.923559    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-36bcab\"/\"kube-root-ca.crt\""
Sep 06 12:32:31.930509 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:31.930486    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"]
Sep 06 12:32:32.008359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.008300    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tmp-dir\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.008359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.008335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-dshm\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.008536 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.008377    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-model-cache\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.008536 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.008420    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcrgg\" (UniqueName: \"kubernetes.io/projected/eaf98c54-6681-40a4-9dcc-dac4531df1ef-kube-api-access-zcrgg\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.008536 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.008503    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-home\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.008695 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.008537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tls-certs\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.109919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.109886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tmp-dir\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.110072 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.109942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-dshm\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.110072 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.110019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-model-cache\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.110072 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.110043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcrgg\" (UniqueName: \"kubernetes.io/projected/eaf98c54-6681-40a4-9dcc-dac4531df1ef-kube-api-access-zcrgg\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.110231 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.110093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-home\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.110231 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.110115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tls-certs\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.110339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.110304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tmp-dir\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.110499 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.110472    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-home\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.110649 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.110590    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-model-cache\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.112286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.112269    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-dshm\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.112936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.112918    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tls-certs\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.121889 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.121870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcrgg\" (UniqueName: \"kubernetes.io/projected/eaf98c54-6681-40a4-9dcc-dac4531df1ef-kube-api-access-zcrgg\") pod \"test-model-36bcab-kserve-57c7fbc76c-6fz8t\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") " pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.230736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.230714    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:32.498742 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:32.498712    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"]
Sep 06 12:32:32.502503 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:32:32.502480    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaf98c54_6681_40a4_9dcc_dac4531df1ef.slice/crio-5c32171573701d2555ce10ac2ef9743a7c1d6203609da6eeee7baf6c3414d819 WatchSource:0}: Error finding container 5c32171573701d2555ce10ac2ef9743a7c1d6203609da6eeee7baf6c3414d819: Status 404 returned error can't find the container with id 5c32171573701d2555ce10ac2ef9743a7c1d6203609da6eeee7baf6c3414d819
Sep 06 12:32:33.082945 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:33.082915    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t" event={"ID":"eaf98c54-6681-40a4-9dcc-dac4531df1ef","Type":"ContainerStarted","Data":"4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623"}
Sep 06 12:32:33.083317 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:33.082954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t" event={"ID":"eaf98c54-6681-40a4-9dcc-dac4531df1ef","Type":"ContainerStarted","Data":"5c32171573701d2555ce10ac2ef9743a7c1d6203609da6eeee7baf6c3414d819"}
Sep 06 12:32:33.104238 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:33.104189    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t" podStartSLOduration=2.104162075 podStartE2EDuration="2.104162075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:32:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:32:33.103006834 +0000 UTC m=+893.077054020" watchObservedRunningTime="2026-09-06 12:32:33.104162075 +0000 UTC m=+893.078209261"
Sep 06 12:32:33.119252 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:33.119217    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:33.219696 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:33.219672    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:36.212783 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:36.212752    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:36.901457 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:36.901418    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:41.722066 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:41.722029    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:42.231685 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.231654    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:42.231935 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.231909    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:42.244129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.244108    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:42.323179 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.323144    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:42.356385 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.356353    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"]
Sep 06 12:32:42.356567 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.356542    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z" podUID="0be236cb-0485-46ae-967d-9260d0ae5282" containerName="payload-processing" containerID="cri-o://0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867" gracePeriod=30
Sep 06 12:32:42.423591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.423562    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:42.520547 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.520436    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:42.527520 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.527494    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"]
Sep 06 12:32:42.527841 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.527814    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549" podUID="80fff7a2-3f4c-4f5b-9ce4-935b3218e487" containerName="payload-processing" containerID="cri-o://d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718" gracePeriod=30
Sep 06 12:32:42.541925 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.541900    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"]
Sep 06 12:32:42.542170 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.542114    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57" podUID="62ea7ed5-5d2f-4cbf-adab-16acd46684ef" containerName="payload-pre-processing" containerID="cri-o://fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b" gracePeriod=30
Sep 06 12:32:42.619971 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.619943    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:42.667801 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.667775    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:42.706169 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.706131    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:42.778245 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.778174    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:42.790230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.790205    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0be236cb-0485-46ae-967d-9260d0ae5282-plugins-config-volume\") pod \"0be236cb-0485-46ae-967d-9260d0ae5282\" (UID: \"0be236cb-0485-46ae-967d-9260d0ae5282\") "
Sep 06 12:32:42.790362 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.790246    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2xfw\" (UniqueName: \"kubernetes.io/projected/0be236cb-0485-46ae-967d-9260d0ae5282-kube-api-access-z2xfw\") pod \"0be236cb-0485-46ae-967d-9260d0ae5282\" (UID: \"0be236cb-0485-46ae-967d-9260d0ae5282\") "
Sep 06 12:32:42.790577 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.790553    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0be236cb-0485-46ae-967d-9260d0ae5282-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0be236cb-0485-46ae-967d-9260d0ae5282" (UID: "0be236cb-0485-46ae-967d-9260d0ae5282"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:42.792776 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.792744    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be236cb-0485-46ae-967d-9260d0ae5282-kube-api-access-z2xfw" (OuterVolumeSpecName: "kube-api-access-z2xfw") pod "0be236cb-0485-46ae-967d-9260d0ae5282" (UID: "0be236cb-0485-46ae-967d-9260d0ae5282"). InnerVolumeSpecName "kube-api-access-z2xfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:32:42.806534 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.806509    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:32:42.813760 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.813744    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:32:42.891294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.891261    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-plugins-config-volume\") pod \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\" (UID: \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\") "
Sep 06 12:32:42.891294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.891296    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlqxw\" (UniqueName: \"kubernetes.io/projected/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-kube-api-access-qlqxw\") pod \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\" (UID: \"62ea7ed5-5d2f-4cbf-adab-16acd46684ef\") "
Sep 06 12:32:42.891546 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.891311    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5bk5\" (UniqueName: \"kubernetes.io/projected/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-kube-api-access-q5bk5\") pod \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\" (UID: \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\") "
Sep 06 12:32:42.891546 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.891372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-plugins-config-volume\") pod \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\" (UID: \"80fff7a2-3f4c-4f5b-9ce4-935b3218e487\") "
Sep 06 12:32:42.891730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.891707    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0be236cb-0485-46ae-967d-9260d0ae5282-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:32:42.891788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.891737    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2xfw\" (UniqueName: \"kubernetes.io/projected/0be236cb-0485-46ae-967d-9260d0ae5282-kube-api-access-z2xfw\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:32:42.891875 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.891838    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62ea7ed5-5d2f-4cbf-adab-16acd46684ef" (UID: "62ea7ed5-5d2f-4cbf-adab-16acd46684ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:42.891998 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.891894    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "80fff7a2-3f4c-4f5b-9ce4-935b3218e487" (UID: "80fff7a2-3f4c-4f5b-9ce4-935b3218e487"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:42.893649 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.893626    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-kube-api-access-qlqxw" (OuterVolumeSpecName: "kube-api-access-qlqxw") pod "62ea7ed5-5d2f-4cbf-adab-16acd46684ef" (UID: "62ea7ed5-5d2f-4cbf-adab-16acd46684ef"). InnerVolumeSpecName "kube-api-access-qlqxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:32:42.893757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.893676    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-kube-api-access-q5bk5" (OuterVolumeSpecName: "kube-api-access-q5bk5") pod "80fff7a2-3f4c-4f5b-9ce4-935b3218e487" (UID: "80fff7a2-3f4c-4f5b-9ce4-935b3218e487"). InnerVolumeSpecName "kube-api-access-q5bk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:32:42.992351 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.992327    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:32:42.992351 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.992348    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:32:42.992503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.992357    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlqxw\" (UniqueName: \"kubernetes.io/projected/62ea7ed5-5d2f-4cbf-adab-16acd46684ef-kube-api-access-qlqxw\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:32:42.992503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:42.992367    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5bk5\" (UniqueName: \"kubernetes.io/projected/80fff7a2-3f4c-4f5b-9ce4-935b3218e487-kube-api-access-q5bk5\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:32:43.129700 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.129632    2568 generic.go:356] "Generic (PLEG): container finished" podID="80fff7a2-3f4c-4f5b-9ce4-935b3218e487" containerID="d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718" exitCode=0
Sep 06 12:32:43.129700 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.129667    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"
Sep 06 12:32:43.129844 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.129709    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549" event={"ID":"80fff7a2-3f4c-4f5b-9ce4-935b3218e487","Type":"ContainerDied","Data":"d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718"}
Sep 06 12:32:43.129844 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.129779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549" event={"ID":"80fff7a2-3f4c-4f5b-9ce4-935b3218e487","Type":"ContainerDied","Data":"cd774df42d44773840a238febde1da8d5939ee237a3d1566908317be95ff7fea"}
Sep 06 12:32:43.129844 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.129803    2568 scope.go:117] "RemoveContainer" containerID="d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718"
Sep 06 12:32:43.131076 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.131056    2568 generic.go:356] "Generic (PLEG): container finished" podID="62ea7ed5-5d2f-4cbf-adab-16acd46684ef" containerID="fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b" exitCode=0
Sep 06 12:32:43.131174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.131111    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"
Sep 06 12:32:43.131238 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.131106    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57" event={"ID":"62ea7ed5-5d2f-4cbf-adab-16acd46684ef","Type":"ContainerDied","Data":"fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b"}
Sep 06 12:32:43.131294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.131230    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57" event={"ID":"62ea7ed5-5d2f-4cbf-adab-16acd46684ef","Type":"ContainerDied","Data":"2326787fd4ca8bf56aa729310c149ce0e44f494518e5a596dbc40b6914719178"}
Sep 06 12:32:43.132753 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.132720    2568 generic.go:356] "Generic (PLEG): container finished" podID="0be236cb-0485-46ae-967d-9260d0ae5282" containerID="0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867" exitCode=0
Sep 06 12:32:43.132868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.132800    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"
Sep 06 12:32:43.132868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.132834    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z" event={"ID":"0be236cb-0485-46ae-967d-9260d0ae5282","Type":"ContainerDied","Data":"0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867"}
Sep 06 12:32:43.132990 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.132872    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z" event={"ID":"0be236cb-0485-46ae-967d-9260d0ae5282","Type":"ContainerDied","Data":"95dafe55347cba2afa418971fb7ecd16802a27ff7087c270ca699140dc247de9"}
Sep 06 12:32:43.139856 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.139656    2568 scope.go:117] "RemoveContainer" containerID="d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718"
Sep 06 12:32:43.140155 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:32:43.140127    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718\": container with ID starting with d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718 not found: ID does not exist" containerID="d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718"
Sep 06 12:32:43.140248 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.140166    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718"} err="failed to get container status \"d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718\": rpc error: code = NotFound desc = could not find container \"d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718\": container with ID starting with d448bf163f0cbe4f4d0a40fa1732dd92d5b352a532e6c2a9f34fdb962c89f718 not found: ID does not exist"
Sep 06 12:32:43.140248 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.140190    2568 scope.go:117] "RemoveContainer" containerID="fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b"
Sep 06 12:32:43.147148 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.147130    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:32:43.149098 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.149081    2568 scope.go:117] "RemoveContainer" containerID="fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b"
Sep 06 12:32:43.149359 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:32:43.149343    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b\": container with ID starting with fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b not found: ID does not exist" containerID="fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b"
Sep 06 12:32:43.149359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.149365    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b"} err="failed to get container status \"fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b\": rpc error: code = NotFound desc = could not find container \"fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b\": container with ID starting with fbe5c4d3cbc650aa8b7316254fb2a1ed60667a293ecb16a8b8bda0fca1165c7b not found: ID does not exist"
Sep 06 12:32:43.149464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.149379    2568 scope.go:117] "RemoveContainer" containerID="0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867"
Sep 06 12:32:43.156104 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.156081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:43.157041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.157026    2568 scope.go:117] "RemoveContainer" containerID="0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867"
Sep 06 12:32:43.157308 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:32:43.157291    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867\": container with ID starting with 0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867 not found: ID does not exist" containerID="0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867"
Sep 06 12:32:43.157350 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.157314    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867"} err="failed to get container status \"0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867\": rpc error: code = NotFound desc = could not find container \"0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867\": container with ID starting with 0b9a868c1af6b4d01bbd32351a83c3d4dc26dda69896eddfe6227d6fd4335867 not found: ID does not exist"
Sep 06 12:32:43.160377 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.160357    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"]
Sep 06 12:32:43.165882 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.165863    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0e6ab1-86c6f7d47-qc549"]
Sep 06 12:32:43.176317 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.176299    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"]
Sep 06 12:32:43.180154 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.180136    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0e6ab1-6bf86cc74-zrn57"]
Sep 06 12:32:43.190643 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.190625    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"]
Sep 06 12:32:43.197313 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.197291    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ff8cf183-66b984d4f7-jqt5z"]
Sep 06 12:32:43.353479 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.353450    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:43.453884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.453842    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:43.555630 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:43.555581    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:44.514133 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:44.514100    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0be236cb-0485-46ae-967d-9260d0ae5282" path="/var/lib/kubelet/pods/0be236cb-0485-46ae-967d-9260d0ae5282/volumes"
Sep 06 12:32:44.514791 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:44.514734    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62ea7ed5-5d2f-4cbf-adab-16acd46684ef" path="/var/lib/kubelet/pods/62ea7ed5-5d2f-4cbf-adab-16acd46684ef/volumes"
Sep 06 12:32:44.515122 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:44.515101    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80fff7a2-3f4c-4f5b-9ce4-935b3218e487" path="/var/lib/kubelet/pods/80fff7a2-3f4c-4f5b-9ce4-935b3218e487/volumes"
Sep 06 12:32:44.836555 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:44.836450    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:48.128429 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:48.128395    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"]
Sep 06 12:32:48.224539 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:48.224503    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:49.987983 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:49.987947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:51.352369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:51.352326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:51.461256 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:51.461223    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:51.552912 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:51.552885    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:51.651641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:51.651553    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:32:52.076084 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:32:52.076046    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:03.147653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.147617    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5" podUID="8567c9a7-8717-47b2-b457-e755a00eec56" containerName="main" containerID="cri-o://a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d" gracePeriod=45
Sep 06 12:33:03.385770 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.385749    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:33:03.541414 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541374    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-home\") pod \"8567c9a7-8717-47b2-b457-e755a00eec56\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") "
Sep 06 12:33:03.541591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541428    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8567c9a7-8717-47b2-b457-e755a00eec56-tls-certs\") pod \"8567c9a7-8717-47b2-b457-e755a00eec56\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") "
Sep 06 12:33:03.541591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541500    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx2wv\" (UniqueName: \"kubernetes.io/projected/8567c9a7-8717-47b2-b457-e755a00eec56-kube-api-access-kx2wv\") pod \"8567c9a7-8717-47b2-b457-e755a00eec56\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") "
Sep 06 12:33:03.541591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541530    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-model-cache\") pod \"8567c9a7-8717-47b2-b457-e755a00eec56\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") "
Sep 06 12:33:03.541591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541583    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-tmp-dir\") pod \"8567c9a7-8717-47b2-b457-e755a00eec56\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") "
Sep 06 12:33:03.541837 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541649    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-dshm\") pod \"8567c9a7-8717-47b2-b457-e755a00eec56\" (UID: \"8567c9a7-8717-47b2-b457-e755a00eec56\") "
Sep 06 12:33:03.541837 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541656    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-home" (OuterVolumeSpecName: "home") pod "8567c9a7-8717-47b2-b457-e755a00eec56" (UID: "8567c9a7-8717-47b2-b457-e755a00eec56"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:03.541837 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541809    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-model-cache" (OuterVolumeSpecName: "model-cache") pod "8567c9a7-8717-47b2-b457-e755a00eec56" (UID: "8567c9a7-8717-47b2-b457-e755a00eec56"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:03.541959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541866    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8567c9a7-8717-47b2-b457-e755a00eec56" (UID: "8567c9a7-8717-47b2-b457-e755a00eec56"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:03.541959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541950    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:03.542026 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541964    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:03.542026 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.541980    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:03.543795 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.543774    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-dshm" (OuterVolumeSpecName: "dshm") pod "8567c9a7-8717-47b2-b457-e755a00eec56" (UID: "8567c9a7-8717-47b2-b457-e755a00eec56"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:03.544064 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.544037    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8567c9a7-8717-47b2-b457-e755a00eec56-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8567c9a7-8717-47b2-b457-e755a00eec56" (UID: "8567c9a7-8717-47b2-b457-e755a00eec56"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:33:03.544157 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.544066    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8567c9a7-8717-47b2-b457-e755a00eec56-kube-api-access-kx2wv" (OuterVolumeSpecName: "kube-api-access-kx2wv") pod "8567c9a7-8717-47b2-b457-e755a00eec56" (UID: "8567c9a7-8717-47b2-b457-e755a00eec56"). InnerVolumeSpecName "kube-api-access-kx2wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:33:03.643329 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.643300    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8567c9a7-8717-47b2-b457-e755a00eec56-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:03.643329 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.643327    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8567c9a7-8717-47b2-b457-e755a00eec56-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:03.643494 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:03.643343    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx2wv\" (UniqueName: \"kubernetes.io/projected/8567c9a7-8717-47b2-b457-e755a00eec56-kube-api-access-kx2wv\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:04.240129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.240103    2568 generic.go:356] "Generic (PLEG): container finished" podID="8567c9a7-8717-47b2-b457-e755a00eec56" containerID="a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d" exitCode=0
Sep 06 12:33:04.240467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.240143    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"
Sep 06 12:33:04.240467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.240164    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5" event={"ID":"8567c9a7-8717-47b2-b457-e755a00eec56","Type":"ContainerDied","Data":"a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d"}
Sep 06 12:33:04.240467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.240195    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5" event={"ID":"8567c9a7-8717-47b2-b457-e755a00eec56","Type":"ContainerDied","Data":"12d4bf2e7945186f50993abec41932240e3a768e0a2575025cc820217fba39ae"}
Sep 06 12:33:04.240467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.240211    2568 scope.go:117] "RemoveContainer" containerID="a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d"
Sep 06 12:33:04.250122 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.250103    2568 scope.go:117] "RemoveContainer" containerID="a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d"
Sep 06 12:33:04.250384 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:33:04.250367    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d\": container with ID starting with a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d not found: ID does not exist" containerID="a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d"
Sep 06 12:33:04.250456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.250407    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d"} err="failed to get container status \"a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d\": rpc error: code = NotFound desc = could not find container \"a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d\": container with ID starting with a6a4d7727a41fbfe7214d93eab064badde4a41d92d1a6f529b1ff042eb0f9a2d not found: ID does not exist"
Sep 06 12:33:04.261735 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.261714    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"]
Sep 06 12:33:04.264781 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.264760    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-0e6ab1/autores-model-0e6ab1-kserve-5bbf788b9f-bx2g5"]
Sep 06 12:33:04.515161 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:04.515086    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8567c9a7-8717-47b2-b457-e755a00eec56" path="/var/lib/kubelet/pods/8567c9a7-8717-47b2-b457-e755a00eec56/volumes"
Sep 06 12:33:05.193768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:05.193740    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:05.289994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:05.289962    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:06.524290 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524253    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"]
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524558    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80fff7a2-3f4c-4f5b-9ce4-935b3218e487" containerName="payload-processing"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524568    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="80fff7a2-3f4c-4f5b-9ce4-935b3218e487" containerName="payload-processing"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524583    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be236cb-0485-46ae-967d-9260d0ae5282" containerName="payload-processing"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524589    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be236cb-0485-46ae-967d-9260d0ae5282" containerName="payload-processing"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524613    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8567c9a7-8717-47b2-b457-e755a00eec56" containerName="main"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524620    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8567c9a7-8717-47b2-b457-e755a00eec56" containerName="main"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524626    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ea7ed5-5d2f-4cbf-adab-16acd46684ef" containerName="payload-pre-processing"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524632    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ea7ed5-5d2f-4cbf-adab-16acd46684ef" containerName="payload-pre-processing"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524680    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be236cb-0485-46ae-967d-9260d0ae5282" containerName="payload-processing"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524689    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="80fff7a2-3f4c-4f5b-9ce4-935b3218e487" containerName="payload-processing"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524695    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8567c9a7-8717-47b2-b457-e755a00eec56" containerName="main"
Sep 06 12:33:06.524820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.524700    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ea7ed5-5d2f-4cbf-adab-16acd46684ef" containerName="payload-pre-processing"
Sep 06 12:33:06.527545 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.527529    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.529649 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.529632    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-cf61fce7-kserve-self-signed-certs\""
Sep 06 12:33:06.537667 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.537648    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"]
Sep 06 12:33:06.611875 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.611852    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:06.666836 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.666812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-home\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.666924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.666850    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7qf\" (UniqueName: \"kubernetes.io/projected/d0d48c12-63b1-4820-8c96-92d645cc2c35-kube-api-access-dn7qf\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.666924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.666898    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-tmp-dir\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.666924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.666914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-dshm\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.667048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.666934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-model-cache\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.667048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.666965    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d48c12-63b1-4820-8c96-92d645cc2c35-tls-certs\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768328 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768301    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-home\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768344    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7qf\" (UniqueName: \"kubernetes.io/projected/d0d48c12-63b1-4820-8c96-92d645cc2c35-kube-api-access-dn7qf\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768378    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-tmp-dir\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-dshm\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768415    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-model-cache\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d48c12-63b1-4820-8c96-92d645cc2c35-tls-certs\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-home\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768765    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-tmp-dir\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.768945 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.768854    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-model-cache\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.770828 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.770804    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-dshm\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.770935 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.770918    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d48c12-63b1-4820-8c96-92d645cc2c35-tls-certs\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.784077 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.784017    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7qf\" (UniqueName: \"kubernetes.io/projected/d0d48c12-63b1-4820-8c96-92d645cc2c35-kube-api-access-dn7qf\") pod \"e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") " pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:06.836433 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:06.836412    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:07.113025 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:07.113000    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"]
Sep 06 12:33:07.114043 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:33:07.114018    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0d48c12_63b1_4820_8c96_92d645cc2c35.slice/crio-370768bcc61853a1cd09920146e12dcf86923215f4c374bc1b706d61d71f27a3 WatchSource:0}: Error finding container 370768bcc61853a1cd09920146e12dcf86923215f4c374bc1b706d61d71f27a3: Status 404 returned error can't find the container with id 370768bcc61853a1cd09920146e12dcf86923215f4c374bc1b706d61d71f27a3
Sep 06 12:33:07.256996 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:07.256964    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk" event={"ID":"d0d48c12-63b1-4820-8c96-92d645cc2c35","Type":"ContainerStarted","Data":"55b0b87e94a8087d4175c584ac68b77118fbe4147324f629a0f5f24180b6da21"}
Sep 06 12:33:07.257133 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:07.257005    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk" event={"ID":"d0d48c12-63b1-4820-8c96-92d645cc2c35","Type":"ContainerStarted","Data":"370768bcc61853a1cd09920146e12dcf86923215f4c374bc1b706d61d71f27a3"}
Sep 06 12:33:07.273322 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:07.273279    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk" podStartSLOduration=1.27326458 podStartE2EDuration="1.27326458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:33:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:33:07.272262577 +0000 UTC m=+927.246309761" watchObservedRunningTime="2026-09-06 12:33:07.27326458 +0000 UTC m=+927.247311765"
Sep 06 12:33:08.793206 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:08.793169    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:16.837077 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:16.837046    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:16.837521 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:16.837102    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:16.849849 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:16.849828    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:17.313462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:17.313440    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:17.916136 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:17.916104    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:21.237107 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:21.237067    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"]
Sep 06 12:33:21.259727 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:21.259701    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:22.923655 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:22.923590    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:24.046162 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:24.046124    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:24.148184 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:24.148157    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:24.245831 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:24.245808    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:26.081058 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:26.081017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:26.325099 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:26.325066    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:26.726592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:26.726555    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:27.023550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:27.023470    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:27.486977 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:27.486944    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:29.836307 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:29.836277    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:29.930963 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:29.930931    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:31.192029 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:31.191985    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:31.292946 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:31.292915    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:31.393927 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:31.393900    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:31.689592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:31.689559    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:31.758417 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:31.758377    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:36.256904 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.256858    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk" podUID="d0d48c12-63b1-4820-8c96-92d645cc2c35" containerName="main" containerID="cri-o://55b0b87e94a8087d4175c584ac68b77118fbe4147324f629a0f5f24180b6da21" gracePeriod=45
Sep 06 12:33:36.399090 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.399058    2568 generic.go:356] "Generic (PLEG): container finished" podID="d0d48c12-63b1-4820-8c96-92d645cc2c35" containerID="55b0b87e94a8087d4175c584ac68b77118fbe4147324f629a0f5f24180b6da21" exitCode=0
Sep 06 12:33:36.399215 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.399110    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk" event={"ID":"d0d48c12-63b1-4820-8c96-92d645cc2c35","Type":"ContainerDied","Data":"55b0b87e94a8087d4175c584ac68b77118fbe4147324f629a0f5f24180b6da21"}
Sep 06 12:33:36.503162 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.503138    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:36.592556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592494    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-model-cache\") pod \"d0d48c12-63b1-4820-8c96-92d645cc2c35\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") "
Sep 06 12:33:36.592556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592537    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-dshm\") pod \"d0d48c12-63b1-4820-8c96-92d645cc2c35\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") "
Sep 06 12:33:36.592788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592566    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-tmp-dir\") pod \"d0d48c12-63b1-4820-8c96-92d645cc2c35\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") "
Sep 06 12:33:36.592788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592673    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d48c12-63b1-4820-8c96-92d645cc2c35-tls-certs\") pod \"d0d48c12-63b1-4820-8c96-92d645cc2c35\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") "
Sep 06 12:33:36.592788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592698    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-home\") pod \"d0d48c12-63b1-4820-8c96-92d645cc2c35\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") "
Sep 06 12:33:36.592788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592723    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn7qf\" (UniqueName: \"kubernetes.io/projected/d0d48c12-63b1-4820-8c96-92d645cc2c35-kube-api-access-dn7qf\") pod \"d0d48c12-63b1-4820-8c96-92d645cc2c35\" (UID: \"d0d48c12-63b1-4820-8c96-92d645cc2c35\") "
Sep 06 12:33:36.592788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592757    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0d48c12-63b1-4820-8c96-92d645cc2c35" (UID: "d0d48c12-63b1-4820-8c96-92d645cc2c35"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:36.593056 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592896    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0d48c12-63b1-4820-8c96-92d645cc2c35" (UID: "d0d48c12-63b1-4820-8c96-92d645cc2c35"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:36.593056 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592912    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-home" (OuterVolumeSpecName: "home") pod "d0d48c12-63b1-4820-8c96-92d645cc2c35" (UID: "d0d48c12-63b1-4820-8c96-92d645cc2c35"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:36.593056 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592971    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:36.593056 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.592983    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:36.594872 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.594841    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-dshm" (OuterVolumeSpecName: "dshm") pod "d0d48c12-63b1-4820-8c96-92d645cc2c35" (UID: "d0d48c12-63b1-4820-8c96-92d645cc2c35"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:36.595006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.594985    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d48c12-63b1-4820-8c96-92d645cc2c35-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0d48c12-63b1-4820-8c96-92d645cc2c35" (UID: "d0d48c12-63b1-4820-8c96-92d645cc2c35"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:33:36.595006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.594997    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d48c12-63b1-4820-8c96-92d645cc2c35-kube-api-access-dn7qf" (OuterVolumeSpecName: "kube-api-access-dn7qf") pod "d0d48c12-63b1-4820-8c96-92d645cc2c35" (UID: "d0d48c12-63b1-4820-8c96-92d645cc2c35"). InnerVolumeSpecName "kube-api-access-dn7qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:33:36.698552 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.698521    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:36.698701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.698566    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d48c12-63b1-4820-8c96-92d645cc2c35-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:36.698701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.698580    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d48c12-63b1-4820-8c96-92d645cc2c35-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:36.698701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:36.698591    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn7qf\" (UniqueName: \"kubernetes.io/projected/d0d48c12-63b1-4820-8c96-92d645cc2c35-kube-api-access-dn7qf\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:33:37.404842 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:37.404817    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"
Sep 06 12:33:37.405245 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:37.404813    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk" event={"ID":"d0d48c12-63b1-4820-8c96-92d645cc2c35","Type":"ContainerDied","Data":"370768bcc61853a1cd09920146e12dcf86923215f4c374bc1b706d61d71f27a3"}
Sep 06 12:33:37.405245 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:37.404936    2568 scope.go:117] "RemoveContainer" containerID="55b0b87e94a8087d4175c584ac68b77118fbe4147324f629a0f5f24180b6da21"
Sep 06 12:33:37.426880 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:37.426854    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"]
Sep 06 12:33:37.433060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:37.433040    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-cf61fce7-kserve-c756b77d-dqttk"]
Sep 06 12:33:38.515138 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:38.515104    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d48c12-63b1-4820-8c96-92d645cc2c35" path="/var/lib/kubelet/pods/d0d48c12-63b1-4820-8c96-92d645cc2c35/volumes"
Sep 06 12:33:40.031220 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:40.031184    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:45.760180 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:45.760145    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:45.831938 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:45.831905    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:45.903031 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:45.903003    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:54.757476 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:54.757440    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:56.431927 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:56.431886    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:57.178232 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:57.178196    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:58.502106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.502060    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"]
Sep 06 12:33:58.502477 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.502387    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d48c12-63b1-4820-8c96-92d645cc2c35" containerName="main"
Sep 06 12:33:58.502477 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.502399    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d48c12-63b1-4820-8c96-92d645cc2c35" containerName="main"
Sep 06 12:33:58.502560 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.502481    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d48c12-63b1-4820-8c96-92d645cc2c35" containerName="main"
Sep 06 12:33:58.507004 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.506983    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.508985 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.508961    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-58053a\"/\"openshift-service-ca.crt\""
Sep 06 12:33:58.509797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.509746    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-58053a\"/\"kube-root-ca.crt\""
Sep 06 12:33:58.509897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.509769    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-58053a\"/\"test-model-58053a-kserve-self-signed-certs\""
Sep 06 12:33:58.509897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.509810    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-58053a\"/\"default-dockercfg-fg9jx\""
Sep 06 12:33:58.516641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.516618    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"]
Sep 06 12:33:58.544975 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.544953    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:33:58.551895 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.551875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfgdj\" (UniqueName: \"kubernetes.io/projected/3706b140-ea2c-4b42-8d33-16c51f079ded-kube-api-access-vfgdj\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.551987 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.551909    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-home\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.552040 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.551985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-tmp-dir\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.552040 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.552019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-model-cache\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.552157 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.552088    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-dshm\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.552157 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.552105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3706b140-ea2c-4b42-8d33-16c51f079ded-tls-certs\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.652795 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.652770    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-dshm\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.652870 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.652799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3706b140-ea2c-4b42-8d33-16c51f079ded-tls-certs\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.652870 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.652817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfgdj\" (UniqueName: \"kubernetes.io/projected/3706b140-ea2c-4b42-8d33-16c51f079ded-kube-api-access-vfgdj\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.652870 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.652844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-home\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.653023 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.652900    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-tmp-dir\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.653023 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.652929    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-model-cache\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.653272 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.653252    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-home\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.653325 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.653309    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-tmp-dir\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.653367 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.653327    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-model-cache\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.655064 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.655046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-dshm\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.655390 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.655371    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3706b140-ea2c-4b42-8d33-16c51f079ded-tls-certs\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.663046 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.663026    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfgdj\" (UniqueName: \"kubernetes.io/projected/3706b140-ea2c-4b42-8d33-16c51f079ded-kube-api-access-vfgdj\") pod \"test-model-58053a-kserve-5f4b87c67c-mh9dk\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") " pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:58.818786 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:58.818719    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:33:59.096150 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:59.096082    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"]
Sep 06 12:33:59.099271 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:33:59.099251    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3706b140_ea2c_4b42_8d33_16c51f079ded.slice/crio-8fb2edf937c2496fa5e2ff788dc27b393a5535926f6448a1a432a071c1dec6dd WatchSource:0}: Error finding container 8fb2edf937c2496fa5e2ff788dc27b393a5535926f6448a1a432a071c1dec6dd: Status 404 returned error can't find the container with id 8fb2edf937c2496fa5e2ff788dc27b393a5535926f6448a1a432a071c1dec6dd
Sep 06 12:33:59.509194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:59.509166    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk" event={"ID":"3706b140-ea2c-4b42-8d33-16c51f079ded","Type":"ContainerStarted","Data":"ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b"}
Sep 06 12:33:59.509577 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:59.509197    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk" event={"ID":"3706b140-ea2c-4b42-8d33-16c51f079ded","Type":"ContainerStarted","Data":"8fb2edf937c2496fa5e2ff788dc27b393a5535926f6448a1a432a071c1dec6dd"}
Sep 06 12:33:59.524954 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:33:59.524911    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk" podStartSLOduration=1.524896911 podStartE2EDuration="1.524896911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:33:59.523672186 +0000 UTC m=+979.497719370" watchObservedRunningTime="2026-09-06 12:33:59.524896911 +0000 UTC m=+979.498944096"
Sep 06 12:34:02.839429 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:02.839340    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:02.944876 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:02.944835    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:03.039263 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:03.039230    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:03.140524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:03.140450    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:03.508454 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:03.508425    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:03.749401 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:03.749373    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:03.848082 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:03.848012    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:03.948665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:03.948635    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:05.318254 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:05.318219    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:06.114003 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:06.113967    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:08.818999 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:08.818972    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:34:08.819489 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:08.819013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:34:08.831264 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:08.831242    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:34:09.565272 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:09.565243    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:34:11.134975 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:11.134942    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:11.235425 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:11.235393    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:11.788339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:11.788304    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:17.759692 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:17.759661    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:17.859367 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:17.859330    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:17.985076 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:17.985047    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:18.262317 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:18.262289    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:18.362116 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:18.362051    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:21.205952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:21.205908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:21.300744 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:21.300708    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:21.369051 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:21.369027    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:22.424460 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:22.424420    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:22.490455 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:22.490424    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:22.912175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:22.912139    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:22.982847 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:22.982812    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:23.016587 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.016564    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"]
Sep 06 12:34:23.019898 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.019884    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:23.021806 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.021783    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b57cd363\""
Sep 06 12:34:23.021906 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.021783    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b57cd363-dockercfg-x4rxq\""
Sep 06 12:34:23.030240 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.030216    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"]
Sep 06 12:34:23.051552 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.051522    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"]
Sep 06 12:34:23.054646 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.054628    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:23.065323 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.065293    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"]
Sep 06 12:34:23.135810 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.135781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9grc\" (UniqueName: \"kubernetes.io/projected/2976d0a6-be29-41e1-be6e-4f8b76398af7-kube-api-access-c9grc\") pod \"payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj\" (UID: \"2976d0a6-be29-41e1-be6e-4f8b76398af7\") " pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:23.135948 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.135851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1de2f65f-cc16-4068-8121-a8bf76989344-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg\" (UID: \"1de2f65f-cc16-4068-8121-a8bf76989344\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:23.135948 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.135903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2976d0a6-be29-41e1-be6e-4f8b76398af7-plugins-config-volume\") pod \"payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj\" (UID: \"2976d0a6-be29-41e1-be6e-4f8b76398af7\") " pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:23.136165 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.136137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9478v\" (UniqueName: \"kubernetes.io/projected/1de2f65f-cc16-4068-8121-a8bf76989344-kube-api-access-9478v\") pod \"payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg\" (UID: \"1de2f65f-cc16-4068-8121-a8bf76989344\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:23.237395 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.237364    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9478v\" (UniqueName: \"kubernetes.io/projected/1de2f65f-cc16-4068-8121-a8bf76989344-kube-api-access-9478v\") pod \"payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg\" (UID: \"1de2f65f-cc16-4068-8121-a8bf76989344\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:23.237650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.237410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9grc\" (UniqueName: \"kubernetes.io/projected/2976d0a6-be29-41e1-be6e-4f8b76398af7-kube-api-access-c9grc\") pod \"payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj\" (UID: \"2976d0a6-be29-41e1-be6e-4f8b76398af7\") " pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:23.237650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.237556    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1de2f65f-cc16-4068-8121-a8bf76989344-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg\" (UID: \"1de2f65f-cc16-4068-8121-a8bf76989344\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:23.237811 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.237662    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2976d0a6-be29-41e1-be6e-4f8b76398af7-plugins-config-volume\") pod \"payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj\" (UID: \"2976d0a6-be29-41e1-be6e-4f8b76398af7\") " pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:23.238284 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.238264    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1de2f65f-cc16-4068-8121-a8bf76989344-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg\" (UID: \"1de2f65f-cc16-4068-8121-a8bf76989344\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:23.238451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.238428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2976d0a6-be29-41e1-be6e-4f8b76398af7-plugins-config-volume\") pod \"payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj\" (UID: \"2976d0a6-be29-41e1-be6e-4f8b76398af7\") " pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:23.245396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.245373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9478v\" (UniqueName: \"kubernetes.io/projected/1de2f65f-cc16-4068-8121-a8bf76989344-kube-api-access-9478v\") pod \"payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg\" (UID: \"1de2f65f-cc16-4068-8121-a8bf76989344\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:23.245396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.245391    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9grc\" (UniqueName: \"kubernetes.io/projected/2976d0a6-be29-41e1-be6e-4f8b76398af7-kube-api-access-c9grc\") pod \"payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj\" (UID: \"2976d0a6-be29-41e1-be6e-4f8b76398af7\") " pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:23.331791 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.331750    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:23.364971 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.364767    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:23.603046 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.603022    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"]
Sep 06 12:34:23.605506 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:34:23.605480    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de2f65f_cc16_4068_8121_a8bf76989344.slice/crio-9b9d88ebcaadebd454468533c9859a44075bf01d3b4fb7812ed10f75f24c3704 WatchSource:0}: Error finding container 9b9d88ebcaadebd454468533c9859a44075bf01d3b4fb7812ed10f75f24c3704: Status 404 returned error can't find the container with id 9b9d88ebcaadebd454468533c9859a44075bf01d3b4fb7812ed10f75f24c3704
Sep 06 12:34:23.616650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.616622    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg" event={"ID":"1de2f65f-cc16-4068-8121-a8bf76989344","Type":"ContainerStarted","Data":"9b9d88ebcaadebd454468533c9859a44075bf01d3b4fb7812ed10f75f24c3704"}
Sep 06 12:34:23.646754 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:23.646641    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"]
Sep 06 12:34:23.649028 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:34:23.648996    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2976d0a6_be29_41e1_be6e_4f8b76398af7.slice/crio-53d01af3cc81fb72dfed3af669f7602a14425f23b2442e5d9a115a034c7b3fa5 WatchSource:0}: Error finding container 53d01af3cc81fb72dfed3af669f7602a14425f23b2442e5d9a115a034c7b3fa5: Status 404 returned error can't find the container with id 53d01af3cc81fb72dfed3af669f7602a14425f23b2442e5d9a115a034c7b3fa5
Sep 06 12:34:24.622523 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:24.622492    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj" event={"ID":"2976d0a6-be29-41e1-be6e-4f8b76398af7","Type":"ContainerStarted","Data":"8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4"}
Sep 06 12:34:24.622990 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:24.622544    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj" event={"ID":"2976d0a6-be29-41e1-be6e-4f8b76398af7","Type":"ContainerStarted","Data":"53d01af3cc81fb72dfed3af669f7602a14425f23b2442e5d9a115a034c7b3fa5"}
Sep 06 12:34:24.622990 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:24.622572    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:24.624095 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:24.624070    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg" event={"ID":"1de2f65f-cc16-4068-8121-a8bf76989344","Type":"ContainerStarted","Data":"7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663"}
Sep 06 12:34:24.624204 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:24.624186    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:24.637060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:24.637018    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj" podStartSLOduration=1.637001094 podStartE2EDuration="1.637001094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:34:24.636006753 +0000 UTC m=+1004.610053937" watchObservedRunningTime="2026-09-06 12:34:24.637001094 +0000 UTC m=+1004.611048279"
Sep 06 12:34:24.649187 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:24.649130    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg" podStartSLOduration=1.649111736 podStartE2EDuration="1.649111736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:34:24.648953086 +0000 UTC m=+1004.623000273" watchObservedRunningTime="2026-09-06 12:34:24.649111736 +0000 UTC m=+1004.623158936"
Sep 06 12:34:31.418249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:31.418212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:32.020612 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:32.020562    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:32.196834 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:32.196801    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:32.287803 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:32.287722    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:32.387267 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:32.387240    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:32.664088 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:32.664006    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:35.630434 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:35.630408    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:34:35.630854 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:35.630479    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:34:38.388302 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:38.388262    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:38.488619 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:38.488572    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:38.628730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:38.628693    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:39.053739 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:39.053708    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:39.330212 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:39.330135    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:39.455717 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:39.455677    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:40.813396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:40.813357    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:40.914575 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:40.914547    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:41.013062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:41.013034    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:43.288893 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:43.288857    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:46.133330 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:46.133294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:46.768924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:46.768889    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:46.856995 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:46.856968    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:47.171591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:47.171498    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:49.215722 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.215696    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"]
Sep 06 12:34:49.219102 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.219086    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.221380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.221351    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-363819\"/\"openshift-service-ca.crt\""
Sep 06 12:34:49.222287 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.222263    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-363819\"/\"default-dockercfg-wx69x\""
Sep 06 12:34:49.222391 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.222312    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-363819\"/\"kube-root-ca.crt\""
Sep 06 12:34:49.222391 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.222314    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-363819\"/\"noten-model-363819-kserve-self-signed-certs\""
Sep 06 12:34:49.228029 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.228006    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"]
Sep 06 12:34:49.239541 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.239516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-dshm\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.239674 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.239630    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-model-cache\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.239748 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.239692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-home\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.239748 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.239723    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-tmp-dir\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.239866 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.239750    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnc6c\" (UniqueName: \"kubernetes.io/projected/aa5e4f62-ff58-443a-b16b-964f73199746-kube-api-access-hnc6c\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.239866 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.239803    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa5e4f62-ff58-443a-b16b-964f73199746-tls-certs\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.240156 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.240135    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:49.340959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.340938    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-home\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.341060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.340964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-tmp-dir\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.341060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.340983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnc6c\" (UniqueName: \"kubernetes.io/projected/aa5e4f62-ff58-443a-b16b-964f73199746-kube-api-access-hnc6c\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.341060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.341009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa5e4f62-ff58-443a-b16b-964f73199746-tls-certs\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.341060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.341043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-dshm\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.341298 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.341083    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-model-cache\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.341390 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.341372    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-home\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.341442 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.341414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-tmp-dir\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.341487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.341443    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-model-cache\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.343449 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.343431    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-dshm\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.343744 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.343727    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa5e4f62-ff58-443a-b16b-964f73199746-tls-certs\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.348713 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.348697    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnc6c\" (UniqueName: \"kubernetes.io/projected/aa5e4f62-ff58-443a-b16b-964f73199746-kube-api-access-hnc6c\") pod \"noten-model-363819-kserve-55f97bd59f-jxhcz\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") " pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.529156 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.529089    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:34:49.801869 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:49.801847    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"]
Sep 06 12:34:49.803867 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:34:49.803838    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa5e4f62_ff58_443a_b16b_964f73199746.slice/crio-3578dce09ddf6b37a641c6f1b09f3baeaf80bc0c0e8a917d1143cb4d2b21a7a5 WatchSource:0}: Error finding container 3578dce09ddf6b37a641c6f1b09f3baeaf80bc0c0e8a917d1143cb4d2b21a7a5: Status 404 returned error can't find the container with id 3578dce09ddf6b37a641c6f1b09f3baeaf80bc0c0e8a917d1143cb4d2b21a7a5
Sep 06 12:34:50.741393 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:50.741361    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz" event={"ID":"aa5e4f62-ff58-443a-b16b-964f73199746","Type":"ContainerStarted","Data":"22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec"}
Sep 06 12:34:50.741791 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:50.741397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz" event={"ID":"aa5e4f62-ff58-443a-b16b-964f73199746","Type":"ContainerStarted","Data":"3578dce09ddf6b37a641c6f1b09f3baeaf80bc0c0e8a917d1143cb4d2b21a7a5"}
Sep 06 12:34:50.764589 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:50.764543    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz" podStartSLOduration=1.764529808 podStartE2EDuration="1.764529808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:34:50.762816825 +0000 UTC m=+1030.736864010" watchObservedRunningTime="2026-09-06 12:34:50.764529808 +0000 UTC m=+1030.738577034"
Sep 06 12:34:52.863544 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:52.863515    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:52.924243 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:52.924213    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:53.191144 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.191116    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"]
Sep 06 12:34:53.194551 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.194535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"
Sep 06 12:34:53.196508 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.196484    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:34:53.196656 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.196487    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:34:53.201041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.201017    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"]
Sep 06 12:34:53.269842 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.269811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a088237-ef6f-4cfb-bff6-46c95a91f2a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq\" (UID: \"1a088237-ef6f-4cfb-bff6-46c95a91f2a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"
Sep 06 12:34:53.370822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.370798    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a088237-ef6f-4cfb-bff6-46c95a91f2a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq\" (UID: \"1a088237-ef6f-4cfb-bff6-46c95a91f2a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"
Sep 06 12:34:53.371412 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.371394    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a088237-ef6f-4cfb-bff6-46c95a91f2a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq\" (UID: \"1a088237-ef6f-4cfb-bff6-46c95a91f2a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"
Sep 06 12:34:53.507454 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.507404    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"
Sep 06 12:34:53.776936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.776914    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"]
Sep 06 12:34:53.779190 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:34:53.779153    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a088237_ef6f_4cfb_bff6_46c95a91f2a6.slice/crio-9a28979f4365b9a8903765b451861d8b5bcd55866f20a85536fe2f10a9be76e2 WatchSource:0}: Error finding container 9a28979f4365b9a8903765b451861d8b5bcd55866f20a85536fe2f10a9be76e2: Status 404 returned error can't find the container with id 9a28979f4365b9a8903765b451861d8b5bcd55866f20a85536fe2f10a9be76e2
Sep 06 12:34:53.781098 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:53.781077    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:34:54.761056 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:54.761023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq" event={"ID":"1a088237-ef6f-4cfb-bff6-46c95a91f2a6","Type":"ContainerStarted","Data":"9a28979f4365b9a8903765b451861d8b5bcd55866f20a85536fe2f10a9be76e2"}
Sep 06 12:34:56.409689 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:56.409664    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"]
Sep 06 12:34:56.426440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:56.426411    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:56.528106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:56.528037    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:56.741980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:56.741952    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:56.772441 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:56.772417    2568 generic.go:356] "Generic (PLEG): container finished" podID="1a088237-ef6f-4cfb-bff6-46c95a91f2a6" containerID="ca45a95e74bddaf53ff023587da2d0a9181163de11e965c9a7bce6f4bb0193c2" exitCode=0
Sep 06 12:34:56.772552 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:56.772498    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq" event={"ID":"1a088237-ef6f-4cfb-bff6-46c95a91f2a6","Type":"ContainerDied","Data":"ca45a95e74bddaf53ff023587da2d0a9181163de11e965c9a7bce6f4bb0193c2"}
Sep 06 12:34:56.843959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:56.843891    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:34:57.903294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:57.903276    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"
Sep 06 12:34:58.008309 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:58.008282    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a088237-ef6f-4cfb-bff6-46c95a91f2a6-maas-api-service-ca\") pod \"1a088237-ef6f-4cfb-bff6-46c95a91f2a6\" (UID: \"1a088237-ef6f-4cfb-bff6-46c95a91f2a6\") "
Sep 06 12:34:58.008584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:58.008564    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a088237-ef6f-4cfb-bff6-46c95a91f2a6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a088237-ef6f-4cfb-bff6-46c95a91f2a6" (UID: "1a088237-ef6f-4cfb-bff6-46c95a91f2a6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:34:58.109546 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:58.109490    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a088237-ef6f-4cfb-bff6-46c95a91f2a6-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:34:58.783138 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:58.783074    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq" event={"ID":"1a088237-ef6f-4cfb-bff6-46c95a91f2a6","Type":"ContainerDied","Data":"9a28979f4365b9a8903765b451861d8b5bcd55866f20a85536fe2f10a9be76e2"}
Sep 06 12:34:58.783138 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:58.783108    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"
Sep 06 12:34:58.783138 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:58.783119    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a28979f4365b9a8903765b451861d8b5bcd55866f20a85536fe2f10a9be76e2"
Sep 06 12:34:59.529734 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:34:59.529711    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:35:01.867355 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:01.867324    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:03.787008 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:03.786960    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:03.867099 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:03.867069    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"]
Sep 06 12:35:03.867315 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:03.867291    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj" podUID="2976d0a6-be29-41e1-be6e-4f8b76398af7" containerName="payload-processing" containerID="cri-o://8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4" gracePeriod=30
Sep 06 12:35:03.882929 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:03.882908    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"]
Sep 06 12:35:03.883100 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:03.883081    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg" podUID="1de2f65f-cc16-4068-8121-a8bf76989344" containerName="payload-pre-processing" containerID="cri-o://7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663" gracePeriod=30
Sep 06 12:35:03.940134 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:03.940095    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:04.003838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.003757    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:04.079174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.079141    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"]
Sep 06 12:35:04.081434 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.081410    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b57cd363-nhzgq"]
Sep 06 12:35:04.081924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.081900    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:04.150999 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.150957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:04.159648 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.159626    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:35:04.162510 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.162493    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:35:04.256981 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.256954    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9478v\" (UniqueName: \"kubernetes.io/projected/1de2f65f-cc16-4068-8121-a8bf76989344-kube-api-access-9478v\") pod \"1de2f65f-cc16-4068-8121-a8bf76989344\" (UID: \"1de2f65f-cc16-4068-8121-a8bf76989344\") "
Sep 06 12:35:04.257126 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.257009    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1de2f65f-cc16-4068-8121-a8bf76989344-plugins-config-volume\") pod \"1de2f65f-cc16-4068-8121-a8bf76989344\" (UID: \"1de2f65f-cc16-4068-8121-a8bf76989344\") "
Sep 06 12:35:04.257126 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.257047    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2976d0a6-be29-41e1-be6e-4f8b76398af7-plugins-config-volume\") pod \"2976d0a6-be29-41e1-be6e-4f8b76398af7\" (UID: \"2976d0a6-be29-41e1-be6e-4f8b76398af7\") "
Sep 06 12:35:04.257126 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.257103    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9grc\" (UniqueName: \"kubernetes.io/projected/2976d0a6-be29-41e1-be6e-4f8b76398af7-kube-api-access-c9grc\") pod \"2976d0a6-be29-41e1-be6e-4f8b76398af7\" (UID: \"2976d0a6-be29-41e1-be6e-4f8b76398af7\") "
Sep 06 12:35:04.257433 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.257411    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de2f65f-cc16-4068-8121-a8bf76989344-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1de2f65f-cc16-4068-8121-a8bf76989344" (UID: "1de2f65f-cc16-4068-8121-a8bf76989344"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:04.257508 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.257428    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2976d0a6-be29-41e1-be6e-4f8b76398af7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2976d0a6-be29-41e1-be6e-4f8b76398af7" (UID: "2976d0a6-be29-41e1-be6e-4f8b76398af7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:04.259218 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.259198    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2976d0a6-be29-41e1-be6e-4f8b76398af7-kube-api-access-c9grc" (OuterVolumeSpecName: "kube-api-access-c9grc") pod "2976d0a6-be29-41e1-be6e-4f8b76398af7" (UID: "2976d0a6-be29-41e1-be6e-4f8b76398af7"). InnerVolumeSpecName "kube-api-access-c9grc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:04.259218 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.259208    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de2f65f-cc16-4068-8121-a8bf76989344-kube-api-access-9478v" (OuterVolumeSpecName: "kube-api-access-9478v") pod "1de2f65f-cc16-4068-8121-a8bf76989344" (UID: "1de2f65f-cc16-4068-8121-a8bf76989344"). InnerVolumeSpecName "kube-api-access-9478v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:04.358460 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.358407    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2976d0a6-be29-41e1-be6e-4f8b76398af7-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:04.358460 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.358427    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9grc\" (UniqueName: \"kubernetes.io/projected/2976d0a6-be29-41e1-be6e-4f8b76398af7-kube-api-access-c9grc\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:04.358460 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.358436    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9478v\" (UniqueName: \"kubernetes.io/projected/1de2f65f-cc16-4068-8121-a8bf76989344-kube-api-access-9478v\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:04.358460 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.358444    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1de2f65f-cc16-4068-8121-a8bf76989344-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:04.424677 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.424651    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:04.515114 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.515092    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a088237-ef6f-4cfb-bff6-46c95a91f2a6" path="/var/lib/kubelet/pods/1a088237-ef6f-4cfb-bff6-46c95a91f2a6/volumes"
Sep 06 12:35:04.810855 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.810828    2568 generic.go:356] "Generic (PLEG): container finished" podID="1de2f65f-cc16-4068-8121-a8bf76989344" containerID="7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663" exitCode=0
Sep 06 12:35:04.811178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.810872    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"
Sep 06 12:35:04.811178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.810909    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg" event={"ID":"1de2f65f-cc16-4068-8121-a8bf76989344","Type":"ContainerDied","Data":"7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663"}
Sep 06 12:35:04.811178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.810962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg" event={"ID":"1de2f65f-cc16-4068-8121-a8bf76989344","Type":"ContainerDied","Data":"9b9d88ebcaadebd454468533c9859a44075bf01d3b4fb7812ed10f75f24c3704"}
Sep 06 12:35:04.811178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.810984    2568 scope.go:117] "RemoveContainer" containerID="7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663"
Sep 06 12:35:04.812216 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.812195    2568 generic.go:356] "Generic (PLEG): container finished" podID="2976d0a6-be29-41e1-be6e-4f8b76398af7" containerID="8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4" exitCode=0
Sep 06 12:35:04.812321 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.812232    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj" event={"ID":"2976d0a6-be29-41e1-be6e-4f8b76398af7","Type":"ContainerDied","Data":"8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4"}
Sep 06 12:35:04.812321 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.812248    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"
Sep 06 12:35:04.812321 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.812277    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj" event={"ID":"2976d0a6-be29-41e1-be6e-4f8b76398af7","Type":"ContainerDied","Data":"53d01af3cc81fb72dfed3af669f7602a14425f23b2442e5d9a115a034c7b3fa5"}
Sep 06 12:35:04.819816 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.819799    2568 scope.go:117] "RemoveContainer" containerID="7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663"
Sep 06 12:35:04.820123 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:04.820095    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663\": container with ID starting with 7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663 not found: ID does not exist" containerID="7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663"
Sep 06 12:35:04.820208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.820132    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663"} err="failed to get container status \"7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663\": rpc error: code = NotFound desc = could not find container \"7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663\": container with ID starting with 7f7d0ff793c3271c7dd183cc0079ebf65689e15f1fca6d5288b1dc638740c663 not found: ID does not exist"
Sep 06 12:35:04.820208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.820154    2568 scope.go:117] "RemoveContainer" containerID="8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4"
Sep 06 12:35:04.827316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.827294    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"]
Sep 06 12:35:04.828491 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.828478    2568 scope.go:117] "RemoveContainer" containerID="8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4"
Sep 06 12:35:04.828772 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:04.828754    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4\": container with ID starting with 8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4 not found: ID does not exist" containerID="8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4"
Sep 06 12:35:04.828870 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.828781    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4"} err="failed to get container status \"8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4\": rpc error: code = NotFound desc = could not find container \"8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4\": container with ID starting with 8e59a80303826f9368d28d9096edf447c26ee80263cda3256482933b1993a6f4 not found: ID does not exist"
Sep 06 12:35:04.831433 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.831413    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b57cd363-58d589fc77-bmmwj"]
Sep 06 12:35:04.841494 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.841472    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"]
Sep 06 12:35:04.845771 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:04.845753    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b57cd363-6d97985778-l7zzg"]
Sep 06 12:35:06.514571 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:06.514536    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de2f65f-cc16-4068-8121-a8bf76989344" path="/var/lib/kubelet/pods/1de2f65f-cc16-4068-8121-a8bf76989344/volumes"
Sep 06 12:35:06.514981 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:06.514916    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2976d0a6-be29-41e1-be6e-4f8b76398af7" path="/var/lib/kubelet/pods/2976d0a6-be29-41e1-be6e-4f8b76398af7/volumes"
Sep 06 12:35:09.979832 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:09.979793    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:10.080396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:10.080367    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:10.231027 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:10.230945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:10.538026 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:10.537946    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:10.634755 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:10.634713    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:10.740086 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:10.740044    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:11.429893 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.429860    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz" podUID="aa5e4f62-ff58-443a-b16b-964f73199746" containerName="main" containerID="cri-o://22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec" gracePeriod=45
Sep 06 12:35:11.674770 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.674744    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:35:11.816828 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.816803    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-home\") pod \"aa5e4f62-ff58-443a-b16b-964f73199746\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") "
Sep 06 12:35:11.816953 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.816836    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnc6c\" (UniqueName: \"kubernetes.io/projected/aa5e4f62-ff58-443a-b16b-964f73199746-kube-api-access-hnc6c\") pod \"aa5e4f62-ff58-443a-b16b-964f73199746\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") "
Sep 06 12:35:11.816953 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.816864    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-dshm\") pod \"aa5e4f62-ff58-443a-b16b-964f73199746\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") "
Sep 06 12:35:11.816953 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.816899    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa5e4f62-ff58-443a-b16b-964f73199746-tls-certs\") pod \"aa5e4f62-ff58-443a-b16b-964f73199746\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") "
Sep 06 12:35:11.816953 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.816923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-model-cache\") pod \"aa5e4f62-ff58-443a-b16b-964f73199746\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") "
Sep 06 12:35:11.817124 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.816996    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-tmp-dir\") pod \"aa5e4f62-ff58-443a-b16b-964f73199746\" (UID: \"aa5e4f62-ff58-443a-b16b-964f73199746\") "
Sep 06 12:35:11.817124 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.817079    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-home" (OuterVolumeSpecName: "home") pod "aa5e4f62-ff58-443a-b16b-964f73199746" (UID: "aa5e4f62-ff58-443a-b16b-964f73199746"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:11.817292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.817266    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa5e4f62-ff58-443a-b16b-964f73199746" (UID: "aa5e4f62-ff58-443a-b16b-964f73199746"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:11.817292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.817273    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:11.817440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.817311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa5e4f62-ff58-443a-b16b-964f73199746" (UID: "aa5e4f62-ff58-443a-b16b-964f73199746"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:11.819153 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.819127    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa5e4f62-ff58-443a-b16b-964f73199746-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa5e4f62-ff58-443a-b16b-964f73199746" (UID: "aa5e4f62-ff58-443a-b16b-964f73199746"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:35:11.819153 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.819138    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-dshm" (OuterVolumeSpecName: "dshm") pod "aa5e4f62-ff58-443a-b16b-964f73199746" (UID: "aa5e4f62-ff58-443a-b16b-964f73199746"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:11.819276 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.819157    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5e4f62-ff58-443a-b16b-964f73199746-kube-api-access-hnc6c" (OuterVolumeSpecName: "kube-api-access-hnc6c") pod "aa5e4f62-ff58-443a-b16b-964f73199746" (UID: "aa5e4f62-ff58-443a-b16b-964f73199746"). InnerVolumeSpecName "kube-api-access-hnc6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:11.847086 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.847059    2568 generic.go:356] "Generic (PLEG): container finished" podID="aa5e4f62-ff58-443a-b16b-964f73199746" containerID="22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec" exitCode=0
Sep 06 12:35:11.847178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.847100    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"
Sep 06 12:35:11.847178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.847108    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz" event={"ID":"aa5e4f62-ff58-443a-b16b-964f73199746","Type":"ContainerDied","Data":"22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec"}
Sep 06 12:35:11.847178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.847139    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz" event={"ID":"aa5e4f62-ff58-443a-b16b-964f73199746","Type":"ContainerDied","Data":"3578dce09ddf6b37a641c6f1b09f3baeaf80bc0c0e8a917d1143cb4d2b21a7a5"}
Sep 06 12:35:11.847178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.847158    2568 scope.go:117] "RemoveContainer" containerID="22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec"
Sep 06 12:35:11.856061 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.856045    2568 scope.go:117] "RemoveContainer" containerID="22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec"
Sep 06 12:35:11.856332 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:11.856312    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec\": container with ID starting with 22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec not found: ID does not exist" containerID="22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec"
Sep 06 12:35:11.856384 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.856342    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec"} err="failed to get container status \"22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec\": rpc error: code = NotFound desc = could not find container \"22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec\": container with ID starting with 22b487f75cf597b8f245e027396f0c0d29e5fbe96059b4ee90b36781a77836ec not found: ID does not exist"
Sep 06 12:35:11.876418 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.876389    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"]
Sep 06 12:35:11.885641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.885621    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-363819/noten-model-363819-kserve-55f97bd59f-jxhcz"]
Sep 06 12:35:11.918492 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.918472    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:11.918492 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.918489    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnc6c\" (UniqueName: \"kubernetes.io/projected/aa5e4f62-ff58-443a-b16b-964f73199746-kube-api-access-hnc6c\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:11.918624 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.918499    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:11.918624 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.918508    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa5e4f62-ff58-443a-b16b-964f73199746-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:11.918624 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:11.918516    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa5e4f62-ff58-443a-b16b-964f73199746-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:12.514367 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:12.514335    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5e4f62-ff58-443a-b16b-964f73199746" path="/var/lib/kubelet/pods/aa5e4f62-ff58-443a-b16b-964f73199746/volumes"
Sep 06 12:35:13.038288 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:13.038259    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"]
Sep 06 12:35:13.058701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:13.058671    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:14.029122 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:14.029092    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"]
Sep 06 12:35:14.049348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:14.049320    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:14.280354 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:14.280236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:16.391913 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:16.391875    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:16.490610 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:16.490561    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:16.589414 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:16.589384    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:16.643192 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:16.643097    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:16.722855 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:16.722823    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:22.487065 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:22.487035    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:22.553483 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:22.553446    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:23.368028 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:23.367991    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:23.420178 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:23.420143    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:23.646865 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:23.646796    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:23.743586 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:23.743559    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:24.604412 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:24.604385    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:24.697278 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:24.697238    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:24.760718 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:24.760676    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:24.828191 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:24.828153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:25.105716 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:25.105677    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:25.169024 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:25.168994    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:26.695962 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:26.695926    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:26.787846 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:26.787816    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:27.988102 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:27.988070    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:28.058513 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.058478    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t" podUID="eaf98c54-6681-40a4-9dcc-dac4531df1ef" containerName="main" containerID="cri-o://4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623" gracePeriod=45
Sep 06 12:35:28.085850 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.085824    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:28.306080 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.306060    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:35:28.439426 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.439386    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:28.446389 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446369    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcrgg\" (UniqueName: \"kubernetes.io/projected/eaf98c54-6681-40a4-9dcc-dac4531df1ef-kube-api-access-zcrgg\") pod \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") "
Sep 06 12:35:28.446478 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446402    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tmp-dir\") pod \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") "
Sep 06 12:35:28.446478 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446441    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-dshm\") pod \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") "
Sep 06 12:35:28.446478 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446454    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-home\") pod \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") "
Sep 06 12:35:28.446478 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446472    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tls-certs\") pod \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") "
Sep 06 12:35:28.446698 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446503    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-model-cache\") pod \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\" (UID: \"eaf98c54-6681-40a4-9dcc-dac4531df1ef\") "
Sep 06 12:35:28.446785 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446755    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-home" (OuterVolumeSpecName: "home") pod "eaf98c54-6681-40a4-9dcc-dac4531df1ef" (UID: "eaf98c54-6681-40a4-9dcc-dac4531df1ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:28.446922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446772    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eaf98c54-6681-40a4-9dcc-dac4531df1ef" (UID: "eaf98c54-6681-40a4-9dcc-dac4531df1ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:28.446922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.446825    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "eaf98c54-6681-40a4-9dcc-dac4531df1ef" (UID: "eaf98c54-6681-40a4-9dcc-dac4531df1ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:28.448665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.448642    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf98c54-6681-40a4-9dcc-dac4531df1ef-kube-api-access-zcrgg" (OuterVolumeSpecName: "kube-api-access-zcrgg") pod "eaf98c54-6681-40a4-9dcc-dac4531df1ef" (UID: "eaf98c54-6681-40a4-9dcc-dac4531df1ef"). InnerVolumeSpecName "kube-api-access-zcrgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:28.448751 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.448664    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-dshm" (OuterVolumeSpecName: "dshm") pod "eaf98c54-6681-40a4-9dcc-dac4531df1ef" (UID: "eaf98c54-6681-40a4-9dcc-dac4531df1ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:28.448751 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.448725    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eaf98c54-6681-40a4-9dcc-dac4531df1ef" (UID: "eaf98c54-6681-40a4-9dcc-dac4531df1ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:35:28.540264 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.540196    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:28.547080 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.547058    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:28.547080 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.547079    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcrgg\" (UniqueName: \"kubernetes.io/projected/eaf98c54-6681-40a4-9dcc-dac4531df1ef-kube-api-access-zcrgg\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:28.547220 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.547099    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:28.547220 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.547107    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:28.547220 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.547116    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf98c54-6681-40a4-9dcc-dac4531df1ef-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:28.547220 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.547123    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf98c54-6681-40a4-9dcc-dac4531df1ef-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:28.931665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.931569    2568 generic.go:356] "Generic (PLEG): container finished" podID="eaf98c54-6681-40a4-9dcc-dac4531df1ef" containerID="4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623" exitCode=0
Sep 06 12:35:28.931665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.931626    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"
Sep 06 12:35:28.931665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.931633    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t" event={"ID":"eaf98c54-6681-40a4-9dcc-dac4531df1ef","Type":"ContainerDied","Data":"4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623"}
Sep 06 12:35:28.931883 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.931673    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t" event={"ID":"eaf98c54-6681-40a4-9dcc-dac4531df1ef","Type":"ContainerDied","Data":"5c32171573701d2555ce10ac2ef9743a7c1d6203609da6eeee7baf6c3414d819"}
Sep 06 12:35:28.931883 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.931696    2568 scope.go:117] "RemoveContainer" containerID="4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623"
Sep 06 12:35:28.941137 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.941119    2568 scope.go:117] "RemoveContainer" containerID="4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623"
Sep 06 12:35:28.941377 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:28.941351    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623\": container with ID starting with 4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623 not found: ID does not exist" containerID="4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623"
Sep 06 12:35:28.941503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.941380    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623"} err="failed to get container status \"4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623\": rpc error: code = NotFound desc = could not find container \"4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623\": container with ID starting with 4810abb7e96d41d8ee6e28b06aaf484d4a8079814601f6a534686244678f8623 not found: ID does not exist"
Sep 06 12:35:28.949505 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.949481    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"]
Sep 06 12:35:28.951194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:28.951175    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-36bcab/test-model-36bcab-kserve-57c7fbc76c-6fz8t"]
Sep 06 12:35:29.049273 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.049251    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk" podUID="3706b140-ea2c-4b42-8d33-16c51f079ded" containerName="main" containerID="cri-o://ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b" gracePeriod=45
Sep 06 12:35:29.292718 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.292697    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:35:29.455511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455487    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfgdj\" (UniqueName: \"kubernetes.io/projected/3706b140-ea2c-4b42-8d33-16c51f079ded-kube-api-access-vfgdj\") pod \"3706b140-ea2c-4b42-8d33-16c51f079ded\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") "
Sep 06 12:35:29.455647 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-model-cache\") pod \"3706b140-ea2c-4b42-8d33-16c51f079ded\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") "
Sep 06 12:35:29.455647 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455550    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3706b140-ea2c-4b42-8d33-16c51f079ded-tls-certs\") pod \"3706b140-ea2c-4b42-8d33-16c51f079ded\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") "
Sep 06 12:35:29.455647 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455592    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-dshm\") pod \"3706b140-ea2c-4b42-8d33-16c51f079ded\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") "
Sep 06 12:35:29.455808 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455656    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-home\") pod \"3706b140-ea2c-4b42-8d33-16c51f079ded\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") "
Sep 06 12:35:29.455808 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455686    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-tmp-dir\") pod \"3706b140-ea2c-4b42-8d33-16c51f079ded\" (UID: \"3706b140-ea2c-4b42-8d33-16c51f079ded\") "
Sep 06 12:35:29.455808 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455790    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-model-cache" (OuterVolumeSpecName: "model-cache") pod "3706b140-ea2c-4b42-8d33-16c51f079ded" (UID: "3706b140-ea2c-4b42-8d33-16c51f079ded"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:29.455958 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455923    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-home" (OuterVolumeSpecName: "home") pod "3706b140-ea2c-4b42-8d33-16c51f079ded" (UID: "3706b140-ea2c-4b42-8d33-16c51f079ded"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:29.455958 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455946    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3706b140-ea2c-4b42-8d33-16c51f079ded" (UID: "3706b140-ea2c-4b42-8d33-16c51f079ded"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:29.456048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.455995    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:29.456048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.456006    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:29.456048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.456015    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:29.457836 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.457805    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3706b140-ea2c-4b42-8d33-16c51f079ded-kube-api-access-vfgdj" (OuterVolumeSpecName: "kube-api-access-vfgdj") pod "3706b140-ea2c-4b42-8d33-16c51f079ded" (UID: "3706b140-ea2c-4b42-8d33-16c51f079ded"). InnerVolumeSpecName "kube-api-access-vfgdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:29.457967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.457947    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3706b140-ea2c-4b42-8d33-16c51f079ded-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3706b140-ea2c-4b42-8d33-16c51f079ded" (UID: "3706b140-ea2c-4b42-8d33-16c51f079ded"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:35:29.457967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.457955    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-dshm" (OuterVolumeSpecName: "dshm") pod "3706b140-ea2c-4b42-8d33-16c51f079ded" (UID: "3706b140-ea2c-4b42-8d33-16c51f079ded"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:29.556659 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.556588    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfgdj\" (UniqueName: \"kubernetes.io/projected/3706b140-ea2c-4b42-8d33-16c51f079ded-kube-api-access-vfgdj\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:29.556659 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.556630    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3706b140-ea2c-4b42-8d33-16c51f079ded-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:29.556659 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.556644    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3706b140-ea2c-4b42-8d33-16c51f079ded-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:29.941146 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.941106    2568 generic.go:356] "Generic (PLEG): container finished" podID="3706b140-ea2c-4b42-8d33-16c51f079ded" containerID="ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b" exitCode=0
Sep 06 12:35:29.941292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.941147    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"
Sep 06 12:35:29.941292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.941186    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk" event={"ID":"3706b140-ea2c-4b42-8d33-16c51f079ded","Type":"ContainerDied","Data":"ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b"}
Sep 06 12:35:29.941292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.941233    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk" event={"ID":"3706b140-ea2c-4b42-8d33-16c51f079ded","Type":"ContainerDied","Data":"8fb2edf937c2496fa5e2ff788dc27b393a5535926f6448a1a432a071c1dec6dd"}
Sep 06 12:35:29.941292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.941253    2568 scope.go:117] "RemoveContainer" containerID="ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b"
Sep 06 12:35:29.956128 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.956109    2568 scope.go:117] "RemoveContainer" containerID="ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b"
Sep 06 12:35:29.956419 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:29.956399    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b\": container with ID starting with ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b not found: ID does not exist" containerID="ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b"
Sep 06 12:35:29.956461 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.956427    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b"} err="failed to get container status \"ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b\": rpc error: code = NotFound desc = could not find container \"ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b\": container with ID starting with ad76865a82aa032c315b99b2628505916d6494f1f600768c3e445e8292a78a4b not found: ID does not exist"
Sep 06 12:35:29.965295 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.965270    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"]
Sep 06 12:35:29.969569 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:29.969545    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-58053a/test-model-58053a-kserve-5f4b87c67c-mh9dk"]
Sep 06 12:35:30.514902 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:30.514868    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3706b140-ea2c-4b42-8d33-16c51f079ded" path="/var/lib/kubelet/pods/3706b140-ea2c-4b42-8d33-16c51f079ded/volumes"
Sep 06 12:35:30.515245 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:30.515219    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf98c54-6681-40a4-9dcc-dac4531df1ef" path="/var/lib/kubelet/pods/eaf98c54-6681-40a4-9dcc-dac4531df1ef/volumes"
Sep 06 12:35:30.904702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:30.904632    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:30.967946 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:30.967917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:31.146243 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.146212    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:31.454032 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.453996    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"]
Sep 06 12:35:31.454381 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454364    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de2f65f-cc16-4068-8121-a8bf76989344" containerName="payload-pre-processing"
Sep 06 12:35:31.454462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454385    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de2f65f-cc16-4068-8121-a8bf76989344" containerName="payload-pre-processing"
Sep 06 12:35:31.454462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454401    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2976d0a6-be29-41e1-be6e-4f8b76398af7" containerName="payload-processing"
Sep 06 12:35:31.454462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454409    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2976d0a6-be29-41e1-be6e-4f8b76398af7" containerName="payload-processing"
Sep 06 12:35:31.454462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454426    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf98c54-6681-40a4-9dcc-dac4531df1ef" containerName="main"
Sep 06 12:35:31.454462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454434    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf98c54-6681-40a4-9dcc-dac4531df1ef" containerName="main"
Sep 06 12:35:31.454462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454455    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a088237-ef6f-4cfb-bff6-46c95a91f2a6" containerName="revoke-keys"
Sep 06 12:35:31.454462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454463    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a088237-ef6f-4cfb-bff6-46c95a91f2a6" containerName="revoke-keys"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454475    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5e4f62-ff58-443a-b16b-964f73199746" containerName="main"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454483    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5e4f62-ff58-443a-b16b-964f73199746" containerName="main"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454495    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3706b140-ea2c-4b42-8d33-16c51f079ded" containerName="main"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454504    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3706b140-ea2c-4b42-8d33-16c51f079ded" containerName="main"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454581    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2976d0a6-be29-41e1-be6e-4f8b76398af7" containerName="payload-processing"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454594    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3706b140-ea2c-4b42-8d33-16c51f079ded" containerName="main"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454622    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf98c54-6681-40a4-9dcc-dac4531df1ef" containerName="main"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454632    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de2f65f-cc16-4068-8121-a8bf76989344" containerName="payload-pre-processing"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454641    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a088237-ef6f-4cfb-bff6-46c95a91f2a6" containerName="revoke-keys"
Sep 06 12:35:31.454838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.454651    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5e4f62-ff58-443a-b16b-964f73199746" containerName="main"
Sep 06 12:35:31.459108 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.459088    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"
Sep 06 12:35:31.461005 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.460977    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:35:31.461005 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.460998    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:35:31.464485 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.464463    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"]
Sep 06 12:35:31.571741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.571686    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0291aea2-9656-4b7f-a730-697dd5822d9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-58053a-ttqps\" (UID: \"0291aea2-9656-4b7f-a730-697dd5822d9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"
Sep 06 12:35:31.579807 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.579781    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:31.672165 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.672141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0291aea2-9656-4b7f-a730-697dd5822d9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-58053a-ttqps\" (UID: \"0291aea2-9656-4b7f-a730-697dd5822d9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"
Sep 06 12:35:31.672726 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.672709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0291aea2-9656-4b7f-a730-697dd5822d9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-58053a-ttqps\" (UID: \"0291aea2-9656-4b7f-a730-697dd5822d9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"
Sep 06 12:35:31.770265 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:31.770204    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"
Sep 06 12:35:32.038906 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:32.038846    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"]
Sep 06 12:35:32.041063 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:35:32.041025    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0291aea2_9656_4b7f_a730_697dd5822d9d.slice/crio-53bc8e55f0176de3da4dc4c1b8b3c8b0a6110bb5f5e7dacda955e49a8cac59bc WatchSource:0}: Error finding container 53bc8e55f0176de3da4dc4c1b8b3c8b0a6110bb5f5e7dacda955e49a8cac59bc: Status 404 returned error can't find the container with id 53bc8e55f0176de3da4dc4c1b8b3c8b0a6110bb5f5e7dacda955e49a8cac59bc
Sep 06 12:35:32.959791 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:32.959763    2568 generic.go:356] "Generic (PLEG): container finished" podID="0291aea2-9656-4b7f-a730-697dd5822d9d" containerID="f73ddb3f0990ba75ed3cd9639581a7832541b8800c645dda0ece29573d91c293" exitCode=0
Sep 06 12:35:32.960132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:32.959849    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps" event={"ID":"0291aea2-9656-4b7f-a730-697dd5822d9d","Type":"ContainerDied","Data":"f73ddb3f0990ba75ed3cd9639581a7832541b8800c645dda0ece29573d91c293"}
Sep 06 12:35:32.960132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:32.959898    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps" event={"ID":"0291aea2-9656-4b7f-a730-697dd5822d9d","Type":"ContainerStarted","Data":"53bc8e55f0176de3da4dc4c1b8b3c8b0a6110bb5f5e7dacda955e49a8cac59bc"}
Sep 06 12:35:34.090473 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:34.090448    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"
Sep 06 12:35:34.191351 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:34.191318    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0291aea2-9656-4b7f-a730-697dd5822d9d-maas-api-service-ca\") pod \"0291aea2-9656-4b7f-a730-697dd5822d9d\" (UID: \"0291aea2-9656-4b7f-a730-697dd5822d9d\") "
Sep 06 12:35:34.191665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:34.191645    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0291aea2-9656-4b7f-a730-697dd5822d9d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0291aea2-9656-4b7f-a730-697dd5822d9d" (UID: "0291aea2-9656-4b7f-a730-697dd5822d9d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:34.292386 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:34.292315    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0291aea2-9656-4b7f-a730-697dd5822d9d-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:34.971403 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:34.971378    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"
Sep 06 12:35:34.971403 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:34.971391    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps" event={"ID":"0291aea2-9656-4b7f-a730-697dd5822d9d","Type":"ContainerDied","Data":"53bc8e55f0176de3da4dc4c1b8b3c8b0a6110bb5f5e7dacda955e49a8cac59bc"}
Sep 06 12:35:34.971591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:34.971451    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53bc8e55f0176de3da4dc4c1b8b3c8b0a6110bb5f5e7dacda955e49a8cac59bc"
Sep 06 12:35:38.502128 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:38.502086    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:41.907439 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:41.907362    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:41.935720 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:41.935691    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"]
Sep 06 12:35:41.936028 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:41.935999    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59" podUID="1f4e9a6e-87b5-4639-a604-24e9a0b024be" containerName="payload-processing" containerID="cri-o://ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517" gracePeriod=30
Sep 06 12:35:41.942501 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:41.942478    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"]
Sep 06 12:35:41.942909 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:41.942860    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s" podUID="7803468e-8914-4ece-965f-9e65ce325661" containerName="payload-pre-processing" containerID="cri-o://b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1" gracePeriod=30
Sep 06 12:35:42.006976 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.006946    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:42.095510 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.095479    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"]
Sep 06 12:35:42.098443 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.098419    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58053a-ttqps"]
Sep 06 12:35:42.099297 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.099268    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:42.159714 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.159641    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:42.213525 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.213499    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:35:42.216272 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.216250    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:35:42.354792 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.354764    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/7803468e-8914-4ece-965f-9e65ce325661-kube-api-access-xbskc\") pod \"7803468e-8914-4ece-965f-9e65ce325661\" (UID: \"7803468e-8914-4ece-965f-9e65ce325661\") "
Sep 06 12:35:42.354919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.354799    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t25v\" (UniqueName: \"kubernetes.io/projected/1f4e9a6e-87b5-4639-a604-24e9a0b024be-kube-api-access-6t25v\") pod \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\" (UID: \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\") "
Sep 06 12:35:42.354919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.354853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7803468e-8914-4ece-965f-9e65ce325661-plugins-config-volume\") pod \"7803468e-8914-4ece-965f-9e65ce325661\" (UID: \"7803468e-8914-4ece-965f-9e65ce325661\") "
Sep 06 12:35:42.354919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.354877    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f4e9a6e-87b5-4639-a604-24e9a0b024be-plugins-config-volume\") pod \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\" (UID: \"1f4e9a6e-87b5-4639-a604-24e9a0b024be\") "
Sep 06 12:35:42.355252 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.355222    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7803468e-8914-4ece-965f-9e65ce325661-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7803468e-8914-4ece-965f-9e65ce325661" (UID: "7803468e-8914-4ece-965f-9e65ce325661"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:42.355365 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.355275    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f4e9a6e-87b5-4639-a604-24e9a0b024be-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f4e9a6e-87b5-4639-a604-24e9a0b024be" (UID: "1f4e9a6e-87b5-4639-a604-24e9a0b024be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:42.356968 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.356950    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7803468e-8914-4ece-965f-9e65ce325661-kube-api-access-xbskc" (OuterVolumeSpecName: "kube-api-access-xbskc") pod "7803468e-8914-4ece-965f-9e65ce325661" (UID: "7803468e-8914-4ece-965f-9e65ce325661"). InnerVolumeSpecName "kube-api-access-xbskc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:42.357034 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.356991    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4e9a6e-87b5-4639-a604-24e9a0b024be-kube-api-access-6t25v" (OuterVolumeSpecName: "kube-api-access-6t25v") pod "1f4e9a6e-87b5-4639-a604-24e9a0b024be" (UID: "1f4e9a6e-87b5-4639-a604-24e9a0b024be"). InnerVolumeSpecName "kube-api-access-6t25v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:42.452708 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.452673    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:42.455720 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.455706    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7803468e-8914-4ece-965f-9e65ce325661-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:42.455783 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.455724    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f4e9a6e-87b5-4639-a604-24e9a0b024be-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:42.455783 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.455733    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/7803468e-8914-4ece-965f-9e65ce325661-kube-api-access-xbskc\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:42.455783 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.455742    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t25v\" (UniqueName: \"kubernetes.io/projected/1f4e9a6e-87b5-4639-a604-24e9a0b024be-kube-api-access-6t25v\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:42.515959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:42.515926    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0291aea2-9656-4b7f-a730-697dd5822d9d" path="/var/lib/kubelet/pods/0291aea2-9656-4b7f-a730-697dd5822d9d/volumes"
Sep 06 12:35:43.013297 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.013272    2568 generic.go:356] "Generic (PLEG): container finished" podID="7803468e-8914-4ece-965f-9e65ce325661" containerID="b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1" exitCode=0
Sep 06 12:35:43.013637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.013315    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"
Sep 06 12:35:43.013637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.013345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s" event={"ID":"7803468e-8914-4ece-965f-9e65ce325661","Type":"ContainerDied","Data":"b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1"}
Sep 06 12:35:43.013637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.013390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s" event={"ID":"7803468e-8914-4ece-965f-9e65ce325661","Type":"ContainerDied","Data":"1c6ea2227a6ccbb0b068d79c09c12bf06017f9280a000fba3b902fcf3cab8d9e"}
Sep 06 12:35:43.013637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.013421    2568 scope.go:117] "RemoveContainer" containerID="b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1"
Sep 06 12:35:43.014726 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.014706    2568 generic.go:356] "Generic (PLEG): container finished" podID="1f4e9a6e-87b5-4639-a604-24e9a0b024be" containerID="ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517" exitCode=0
Sep 06 12:35:43.014799 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.014753    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"
Sep 06 12:35:43.014799 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.014755    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59" event={"ID":"1f4e9a6e-87b5-4639-a604-24e9a0b024be","Type":"ContainerDied","Data":"ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517"}
Sep 06 12:35:43.014799 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.014793    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59" event={"ID":"1f4e9a6e-87b5-4639-a604-24e9a0b024be","Type":"ContainerDied","Data":"53c7e0e9c19fa0e784b618dcbe80fb7013792f50db734c0b999764c28e455b60"}
Sep 06 12:35:43.022094 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.022077    2568 scope.go:117] "RemoveContainer" containerID="b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1"
Sep 06 12:35:43.022360 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:43.022344    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1\": container with ID starting with b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1 not found: ID does not exist" containerID="b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1"
Sep 06 12:35:43.022404 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.022368    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1"} err="failed to get container status \"b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1\": rpc error: code = NotFound desc = could not find container \"b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1\": container with ID starting with b55994a0cd33f98aa2fbf892861a3dec3a0d40860d6145c326856f729b1832b1 not found: ID does not exist"
Sep 06 12:35:43.022404 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.022385    2568 scope.go:117] "RemoveContainer" containerID="ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517"
Sep 06 12:35:43.030070 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.030053    2568 scope.go:117] "RemoveContainer" containerID="ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517"
Sep 06 12:35:43.030324 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:43.030306    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517\": container with ID starting with ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517 not found: ID does not exist" containerID="ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517"
Sep 06 12:35:43.030397 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.030332    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517"} err="failed to get container status \"ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517\": rpc error: code = NotFound desc = could not find container \"ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517\": container with ID starting with ef996f42b0365d263c718f3919e4464a73c6cbacb51a56ca41a92ad1ccca0517 not found: ID does not exist"
Sep 06 12:35:43.030397 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.030382    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"]
Sep 06 12:35:43.032797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.032773    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-58053a-557b7488fd-2p96s"]
Sep 06 12:35:43.041581 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.041562    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"]
Sep 06 12:35:43.047121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:43.047102    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-58053a-b58cf7d55-vzb59"]
Sep 06 12:35:44.514741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:44.514711    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f4e9a6e-87b5-4639-a604-24e9a0b024be" path="/var/lib/kubelet/pods/1f4e9a6e-87b5-4639-a604-24e9a0b024be/volumes"
Sep 06 12:35:44.515097 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:44.515023    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7803468e-8914-4ece-965f-9e65ce325661" path="/var/lib/kubelet/pods/7803468e-8914-4ece-965f-9e65ce325661/volumes"
Sep 06 12:35:48.438398 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:48.438359    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:48.501693 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:48.501653    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:48.665586 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:48.665557    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"]
Sep 06 12:35:48.665821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:48.665796    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy" containerID="cri-o://7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506" gracePeriod=30
Sep 06 12:35:48.694360 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:48.694292    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:48.982279 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:48.982198    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:49.241835 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.241758    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:49.505206 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505129    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"]
Sep 06 12:35:49.505570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505441    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0291aea2-9656-4b7f-a730-697dd5822d9d" containerName="revoke-keys"
Sep 06 12:35:49.505570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505463    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0291aea2-9656-4b7f-a730-697dd5822d9d" containerName="revoke-keys"
Sep 06 12:35:49.505570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505477    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7803468e-8914-4ece-965f-9e65ce325661" containerName="payload-pre-processing"
Sep 06 12:35:49.505570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505485    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7803468e-8914-4ece-965f-9e65ce325661" containerName="payload-pre-processing"
Sep 06 12:35:49.505570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505508    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4e9a6e-87b5-4639-a604-24e9a0b024be" containerName="payload-processing"
Sep 06 12:35:49.505570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505515    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4e9a6e-87b5-4639-a604-24e9a0b024be" containerName="payload-processing"
Sep 06 12:35:49.505570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505558    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f4e9a6e-87b5-4639-a604-24e9a0b024be" containerName="payload-processing"
Sep 06 12:35:49.505570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505571    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0291aea2-9656-4b7f-a730-697dd5822d9d" containerName="revoke-keys"
Sep 06 12:35:49.505969 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.505581    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7803468e-8914-4ece-965f-9e65ce325661" containerName="payload-pre-processing"
Sep 06 12:35:49.510314 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.510287    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.512448 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.512430    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-3feb92-openshift-default-dockercfg-5m256\""
Sep 06 12:35:49.519838 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.519817    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"]
Sep 06 12:35:49.536243 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.536218    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:49.613644 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613614    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29p8s\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-kube-api-access-29p8s\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.613800 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db785ea4-d387-4946-8efe-85b568477c80-istio-podinfo\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.613800 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613759    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db785ea4-d387-4946-8efe-85b568477c80-istiod-ca-cert\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.613923 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-envoy\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.613923 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-istio-token\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.613923 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-data\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.613923 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-credential-socket\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.614114 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613926    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-certs\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.614114 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.613958    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-socket\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715343 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db785ea4-d387-4946-8efe-85b568477c80-istiod-ca-cert\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715347    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-envoy\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715364    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-istio-token\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715381    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-data\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-credential-socket\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-certs\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-socket\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715790 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29p8s\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-kube-api-access-29p8s\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715790 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db785ea4-d387-4946-8efe-85b568477c80-istio-podinfo\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715867    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-data\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715965 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715901    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-credential-socket\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715965 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715936    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-certs\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.715965 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.715956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-socket\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.716451 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.716434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db785ea4-d387-4946-8efe-85b568477c80-istiod-ca-cert\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.718019 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.717997    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db785ea4-d387-4946-8efe-85b568477c80-istio-podinfo\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.718100 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.718004    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-envoy\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.723081 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.723056    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29p8s\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-kube-api-access-29p8s\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.723732 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.723715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-istio-token\") pod \"e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") " pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:49.822395 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:49.822348    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:50.004450 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:50.004419    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:50.097434 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:50.097315    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"]
Sep 06 12:35:50.100012 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:35:50.099986    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb785ea4_d387_4946_8efe_85b568477c80.slice/crio-fde1becee478c6a1739f0b6ee1035c51bfcc2ab6dce0c11b2752a4e7e4ad03d6 WatchSource:0}: Error finding container fde1becee478c6a1739f0b6ee1035c51bfcc2ab6dce0c11b2752a4e7e4ad03d6: Status 404 returned error can't find the container with id fde1becee478c6a1739f0b6ee1035c51bfcc2ab6dce0c11b2752a4e7e4ad03d6
Sep 06 12:35:50.102131 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:50.102101    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:35:50.102194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:50.102168    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:35:50.102234 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:50.102210    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:35:51.054688 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:51.054652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" event={"ID":"db785ea4-d387-4946-8efe-85b568477c80","Type":"ContainerStarted","Data":"6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631"}
Sep 06 12:35:51.055017 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:51.054709    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" event={"ID":"db785ea4-d387-4946-8efe-85b568477c80","Type":"ContainerStarted","Data":"fde1becee478c6a1739f0b6ee1035c51bfcc2ab6dce0c11b2752a4e7e4ad03d6"}
Sep 06 12:35:51.077082 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:51.077032    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" podStartSLOduration=2.077016632 podStartE2EDuration="2.077016632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:35:51.075047741 +0000 UTC m=+1091.049094926" watchObservedRunningTime="2026-09-06 12:35:51.077016632 +0000 UTC m=+1091.051063817"
Sep 06 12:35:51.614633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:51.614582    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:51.823079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:51.823047    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:51.827939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:51.827919    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:51.925425 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:51.925361    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:52.059440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.059404    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:52.060287 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.060271    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:35:52.211180 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.211149    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"]
Sep 06 12:35:52.214559 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.214541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.216511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.216494    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-556bc6-openshift-default-dockercfg-r6rqg\""
Sep 06 12:35:52.225913 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.225885    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"]
Sep 06 12:35:52.242154 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.242128    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:52.337098 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-certs\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.337267 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-socket\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.337267 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337235    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/693dc496-927c-427b-a441-739916251ffc-istiod-ca-cert\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.337382 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-envoy\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.337382 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337306    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlq4w\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-kube-api-access-xlq4w\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.337382 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-data\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.337552 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-istio-token\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.337552 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-credential-socket\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.337552 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.337475    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/693dc496-927c-427b-a441-739916251ffc-istio-podinfo\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438152 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/693dc496-927c-427b-a441-739916251ffc-istiod-ca-cert\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438293 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-envoy\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438293 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlq4w\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-kube-api-access-xlq4w\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438367 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438312    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-data\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438367 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438351    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-istio-token\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438466 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438413    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-credential-socket\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/693dc496-927c-427b-a441-739916251ffc-istio-podinfo\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438704 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-certs\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438704 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-socket\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438707    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-data\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.438825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.438750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-credential-socket\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.439044 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.439024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-socket\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.439116 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.439053    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-certs\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.439116 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.439099    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/693dc496-927c-427b-a441-739916251ffc-istiod-ca-cert\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.440633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.440591    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-envoy\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.441326 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.441304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/693dc496-927c-427b-a441-739916251ffc-istio-podinfo\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.446042 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.446014    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlq4w\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-kube-api-access-xlq4w\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.446474 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.446458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-istio-token\") pod \"e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") " pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.526445 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.526384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:52.553947 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.553911    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:52.799660 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.799637    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"]
Sep 06 12:35:52.801572 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:35:52.801544    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693dc496_927c_427b_a441_739916251ffc.slice/crio-2dee8bdefcadfb3b2e3d40fe89699004a25b2fc4c81c71a57ff836318bb23382 WatchSource:0}: Error finding container 2dee8bdefcadfb3b2e3d40fe89699004a25b2fc4c81c71a57ff836318bb23382: Status 404 returned error can't find the container with id 2dee8bdefcadfb3b2e3d40fe89699004a25b2fc4c81c71a57ff836318bb23382
Sep 06 12:35:52.803832 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.803783    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:35:52.803951 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.803866    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:35:52.803951 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:52.803913    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:35:53.066014 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.065935    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" event={"ID":"693dc496-927c-427b-a441-739916251ffc","Type":"ContainerStarted","Data":"f8b88708583539e5761036ca0df7800d97e94f9aaa558f8b8135112a101d89da"}
Sep 06 12:35:53.066014 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.065996    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" event={"ID":"693dc496-927c-427b-a441-739916251ffc","Type":"ContainerStarted","Data":"2dee8bdefcadfb3b2e3d40fe89699004a25b2fc4c81c71a57ff836318bb23382"}
Sep 06 12:35:53.098822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.098767    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" podStartSLOduration=1.09874644 podStartE2EDuration="1.09874644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:35:53.097490349 +0000 UTC m=+1093.071537531" watchObservedRunningTime="2026-09-06 12:35:53.09874644 +0000 UTC m=+1093.072793626"
Sep 06 12:35:53.124890 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.124853    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:53.224584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.224559    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:53.527348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.527316    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:53.531878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.531857    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:53.904908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.904888    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:35:53.951312 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951284    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-envoy\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951424 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951355    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-certs\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951424 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951391    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-istio-token\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951424    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-socket\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951461    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c54l\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-kube-api-access-9c54l\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951494    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fc35c6-a581-4307-9568-82d3255d9c74-istiod-ca-cert\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951525    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-credential-socket\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951550    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fc35c6-a581-4307-9568-82d3255d9c74-istio-podinfo\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951628    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-data\") pod \"51fc35c6-a581-4307-9568-82d3255d9c74\" (UID: \"51fc35c6-a581-4307-9568-82d3255d9c74\") "
Sep 06 12:35:53.951768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951628    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:53.951914 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951812    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:53.951914 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951823    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:53.952018 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951924    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:53.952018 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951944    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:53.952018 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.951957    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:53.952156 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.952066    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-data" (OuterVolumeSpecName: "istio-data") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:53.952199 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.952183    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51fc35c6-a581-4307-9568-82d3255d9c74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:53.953588 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.953564    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-istio-token" (OuterVolumeSpecName: "istio-token") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:53.953710 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.953633    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:53.954273 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.954251    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51fc35c6-a581-4307-9568-82d3255d9c74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:35:53.954273 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:53.954256    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-kube-api-access-9c54l" (OuterVolumeSpecName: "kube-api-access-9c54l") pod "51fc35c6-a581-4307-9568-82d3255d9c74" (UID: "51fc35c6-a581-4307-9568-82d3255d9c74"). InnerVolumeSpecName "kube-api-access-9c54l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:54.052971 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.052923    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:54.052971 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.052943    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c54l\" (UniqueName: \"kubernetes.io/projected/51fc35c6-a581-4307-9568-82d3255d9c74-kube-api-access-9c54l\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:54.052971 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.052958    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fc35c6-a581-4307-9568-82d3255d9c74-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:54.052971 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.052969    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fc35c6-a581-4307-9568-82d3255d9c74-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:54.053135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.052978    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:54.053135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.052985    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fc35c6-a581-4307-9568-82d3255d9c74-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:35:54.075823 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.075799    2568 generic.go:356] "Generic (PLEG): container finished" podID="51fc35c6-a581-4307-9568-82d3255d9c74" containerID="7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506" exitCode=0
Sep 06 12:35:54.076079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.075878    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"
Sep 06 12:35:54.076079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.075881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" event={"ID":"51fc35c6-a581-4307-9568-82d3255d9c74","Type":"ContainerDied","Data":"7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506"}
Sep 06 12:35:54.076079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.075960    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq" event={"ID":"51fc35c6-a581-4307-9568-82d3255d9c74","Type":"ContainerDied","Data":"8a53e1f350cf225ba880cf29b00cda2c1599b1ab562392d55cc995be8800d948"}
Sep 06 12:35:54.076079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.075983    2568 scope.go:117] "RemoveContainer" containerID="7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506"
Sep 06 12:35:54.076669 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.076634    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:54.077807 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.077786    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:35:54.085160 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.085142    2568 scope.go:117] "RemoveContainer" containerID="c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65"
Sep 06 12:35:54.092490 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.092474    2568 scope.go:117] "RemoveContainer" containerID="7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506"
Sep 06 12:35:54.092770 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:54.092752    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506\": container with ID starting with 7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506 not found: ID does not exist" containerID="7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506"
Sep 06 12:35:54.092836 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.092777    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506"} err="failed to get container status \"7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506\": rpc error: code = NotFound desc = could not find container \"7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506\": container with ID starting with 7bf944fd4d3dddd330806d4fb8351aabf5d4edc83ec25bb635a3722872901506 not found: ID does not exist"
Sep 06 12:35:54.092836 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.092793    2568 scope.go:117] "RemoveContainer" containerID="c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65"
Sep 06 12:35:54.093055 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:35:54.093040    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65\": container with ID starting with c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65 not found: ID does not exist" containerID="c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65"
Sep 06 12:35:54.093100 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.093060    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65"} err="failed to get container status \"c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65\": rpc error: code = NotFound desc = could not find container \"c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65\": container with ID starting with c373c7b6150d4034f0cb0d3762d1ee3b999507ef6e3ccf1874131c369bb85a65 not found: ID does not exist"
Sep 06 12:35:54.117019 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.116992    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"]
Sep 06 12:35:54.124568 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.124542    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-58053a-openshift-default-555cb6c84d-m8ppq"]
Sep 06 12:35:54.265511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.265478    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:54.368782 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.368695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:54.494015 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.493986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:54.514061 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.514035    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" path="/var/lib/kubelet/pods/51fc35c6-a581-4307-9568-82d3255d9c74/volumes"
Sep 06 12:35:54.736788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.736762    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:54.842655 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:54.842632    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:55.100162 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:55.100072    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:55.197689 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:55.197660    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:56.250352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:56.250322    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:56.318965 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:56.318931    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:56.490730 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:56.490703    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:56.920546 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:56.920515    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:57.026341 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:57.026314    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:35:57.113225 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:35:57.113198    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:08.100750 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:08.100713    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 12:36:08.101231 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:08.100820    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 12:36:09.156617 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:09.156506    2568 generic.go:356] "Generic (PLEG): container finished" podID="db785ea4-d387-4946-8efe-85b568477c80" containerID="6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631" exitCode=0
Sep 06 12:36:09.156617 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:09.156558    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" event={"ID":"db785ea4-d387-4946-8efe-85b568477c80","Type":"ContainerDied","Data":"6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631"}
Sep 06 12:36:09.157483 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:09.157438    2568 scope.go:117] "RemoveContainer" containerID="6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631"
Sep 06 12:36:09.159822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:09.159771    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:09.159923 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:09.159892    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:09.160010 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:09.159987    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:10.166745 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:10.166703    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" event={"ID":"db785ea4-d387-4946-8efe-85b568477c80","Type":"ContainerStarted","Data":"41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5"}
Sep 06 12:36:10.822541 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:10.822514    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:36:10.822860 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:10.822696    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:36:10.822928 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:10.822891    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 06 12:36:11.823478 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:11.823444    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:36:11.823853 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:11.823505    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 06 12:36:12.823557 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:12.823521    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:36:12.824044 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:12.823583    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 06 12:36:13.822941 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:13.822904    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:36:13.823112 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:13.822967    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 06 12:36:14.823650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:14.823591    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:36:14.824113 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:14.823674    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 06 12:36:15.198183 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.198158    2568 generic.go:356] "Generic (PLEG): container finished" podID="693dc496-927c-427b-a441-739916251ffc" containerID="f8b88708583539e5761036ca0df7800d97e94f9aaa558f8b8135112a101d89da" exitCode=0
Sep 06 12:36:15.198348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.198229    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" event={"ID":"693dc496-927c-427b-a441-739916251ffc","Type":"ContainerDied","Data":"f8b88708583539e5761036ca0df7800d97e94f9aaa558f8b8135112a101d89da"}
Sep 06 12:36:15.198742 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.198722    2568 scope.go:117] "RemoveContainer" containerID="f8b88708583539e5761036ca0df7800d97e94f9aaa558f8b8135112a101d89da"
Sep 06 12:36:15.199804 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.199777    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:15.199908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.199844    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:15.199908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.199875    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:15.201469 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.201428    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:15.826062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.826028    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:36:15.826537 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.826396    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:36:15.827013 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:15.826995    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:36:16.204871 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:16.204838    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" event={"ID":"693dc496-927c-427b-a441-739916251ffc","Type":"ContainerStarted","Data":"4389fb3ee12d4ba6ca137939cfc3608e308fa01ccac77d9d1080d06d57f8ce6e"}
Sep 06 12:36:16.527064 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:16.526976    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:36:16.527242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:16.527184    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 06 12:36:16.527315 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:16.527240    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 06 12:36:17.526847 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:17.526811    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 06 12:36:17.527216 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:17.526870    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 06 12:36:17.901116 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:17.901028    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:18.255169 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.255139    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:18.395901 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.395870    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:18.526909 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.526827    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 06 12:36:18.526909 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.526883    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 06 12:36:18.530193 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.530157    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"]
Sep 06 12:36:18.530492 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.530480    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy"
Sep 06 12:36:18.530539 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.530494    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy"
Sep 06 12:36:18.530539 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.530506    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy"
Sep 06 12:36:18.530539 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.530512    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy"
Sep 06 12:36:18.530664 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.530563    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy"
Sep 06 12:36:18.533407 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.533390    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.535492 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.535462    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-e6515e-openshift-default-dockercfg-4mrnb\""
Sep 06 12:36:18.555625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.548640    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"]
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.571822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxc57\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-kube-api-access-qxc57\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.571894    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-data\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.571926    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-podinfo\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.571950    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istiod-ca-cert\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.572001    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-envoy\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.572048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-credential-socket\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.572084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-certs\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.572108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-token\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.572622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.572135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-socket\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.574537 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.574460    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:18.672744 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.672709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-certs\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.672744 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.672748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-token\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.672996 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.672772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-socket\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.672996 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.672927    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxc57\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-kube-api-access-qxc57\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673173 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-certs\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673302 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673164    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-socket\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673347 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-data\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673347 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673340    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-podinfo\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673459 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istiod-ca-cert\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673459 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673409    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-envoy\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673459 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-credential-socket\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673688 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673669    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-data\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.673959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.673939    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-credential-socket\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.674233 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.674143    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istiod-ca-cert\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.675840 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.675817    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-envoy\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.676027 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.676010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-podinfo\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.680249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.680228    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxc57\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-kube-api-access-qxc57\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.680861 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.680845    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-token\") pod \"e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") " pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.860830 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.860738    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:18.912353 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:18.912323    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:19.136952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.136929    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"]
Sep 06 12:36:19.138739 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:36:19.138710    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac86de8_6ec3_4ad7_819a_ec58ec0fa1a6.slice/crio-5427262325d0c30d4b7e02aa130bbabf57a6aa7aa033756728cd9ced269d2ac6 WatchSource:0}: Error finding container 5427262325d0c30d4b7e02aa130bbabf57a6aa7aa033756728cd9ced269d2ac6: Status 404 returned error can't find the container with id 5427262325d0c30d4b7e02aa130bbabf57a6aa7aa033756728cd9ced269d2ac6
Sep 06 12:36:19.141129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.141098    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:19.141208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.141157    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:19.141247 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.141206    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:19.223948 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.223910    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" event={"ID":"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6","Type":"ContainerStarted","Data":"3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983"}
Sep 06 12:36:19.224063 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.223957    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" event={"ID":"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6","Type":"ContainerStarted","Data":"5427262325d0c30d4b7e02aa130bbabf57a6aa7aa033756728cd9ced269d2ac6"}
Sep 06 12:36:19.252618 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.251712    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" podStartSLOduration=1.251689381 podStartE2EDuration="1.251689381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:36:19.248978309 +0000 UTC m=+1119.223025496" watchObservedRunningTime="2026-09-06 12:36:19.251689381 +0000 UTC m=+1119.225736567"
Sep 06 12:36:19.526735 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.526702    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 06 12:36:19.526900 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.526765    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 06 12:36:19.861557 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.861421    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:19.917389 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:19.917358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:20.527079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:20.527047    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 06 12:36:20.527241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:20.527109    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 06 12:36:20.870660 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:20.870560    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:21.205143 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:21.205100    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:21.234494 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:21.234461    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:21.235413 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:21.235395    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:21.293203 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:21.293168    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:21.530545 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:21.530469    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:36:21.530783 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:21.530765    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:36:21.531497 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:21.531480    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:36:22.435300 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:22.435261    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:22.516101 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:22.516070    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:22.614514 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:22.614486    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:22.890434 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:22.890403    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:22.967386 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:22.967355    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:23.006636 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.006611    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"]
Sep 06 12:36:23.006978 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.006965    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="51fc35c6-a581-4307-9568-82d3255d9c74" containerName="istio-proxy"
Sep 06 12:36:23.009878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.009863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:23.012698 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.012676    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-e6515e\""
Sep 06 12:36:23.012791 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.012676    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-e6515e-dockercfg-wb958\""
Sep 06 12:36:23.021109 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.021086    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"]
Sep 06 12:36:23.114251 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.114209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r8qn\" (UniqueName: \"kubernetes.io/projected/1faa4c7d-9a80-4276-ab89-8a965634e196-kube-api-access-6r8qn\") pod \"payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9\" (UID: \"1faa4c7d-9a80-4276-ab89-8a965634e196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:23.114424 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.114267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1faa4c7d-9a80-4276-ab89-8a965634e196-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9\" (UID: \"1faa4c7d-9a80-4276-ab89-8a965634e196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:23.215577 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.215546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r8qn\" (UniqueName: \"kubernetes.io/projected/1faa4c7d-9a80-4276-ab89-8a965634e196-kube-api-access-6r8qn\") pod \"payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9\" (UID: \"1faa4c7d-9a80-4276-ab89-8a965634e196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:23.215786 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.215626    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1faa4c7d-9a80-4276-ab89-8a965634e196-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9\" (UID: \"1faa4c7d-9a80-4276-ab89-8a965634e196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:23.216300 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.216280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1faa4c7d-9a80-4276-ab89-8a965634e196-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9\" (UID: \"1faa4c7d-9a80-4276-ab89-8a965634e196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:23.222850 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.222828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r8qn\" (UniqueName: \"kubernetes.io/projected/1faa4c7d-9a80-4276-ab89-8a965634e196-kube-api-access-6r8qn\") pod \"payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9\" (UID: \"1faa4c7d-9a80-4276-ab89-8a965634e196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:23.321610 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.321576    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:23.588407 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:23.588336    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"]
Sep 06 12:36:23.591374 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:36:23.591348    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1faa4c7d_9a80_4276_ab89_8a965634e196.slice/crio-41a6d44ddeb2c4e8a5ccb4f9d490aafee8e2d2d18628baf767682277240da7d5 WatchSource:0}: Error finding container 41a6d44ddeb2c4e8a5ccb4f9d490aafee8e2d2d18628baf767682277240da7d5: Status 404 returned error can't find the container with id 41a6d44ddeb2c4e8a5ccb4f9d490aafee8e2d2d18628baf767682277240da7d5
Sep 06 12:36:24.250867 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:24.250817    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9" event={"ID":"1faa4c7d-9a80-4276-ab89-8a965634e196","Type":"ContainerStarted","Data":"1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c"}
Sep 06 12:36:24.251030 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:24.250892    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9" event={"ID":"1faa4c7d-9a80-4276-ab89-8a965634e196","Type":"ContainerStarted","Data":"41a6d44ddeb2c4e8a5ccb4f9d490aafee8e2d2d18628baf767682277240da7d5"}
Sep 06 12:36:24.251030 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:24.250917    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:24.266310 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:24.266258    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9" podStartSLOduration=2.266243513 podStartE2EDuration="2.266243513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:36:24.26527693 +0000 UTC m=+1124.239324114" watchObservedRunningTime="2026-09-06 12:36:24.266243513 +0000 UTC m=+1124.240290723"
Sep 06 12:36:34.086649 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.086590    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:34.376029 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.375941    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"]
Sep 06 12:36:34.380068 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.380044    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.382469 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.382375    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-48920d6f-openshift-default-dockercfg-46gh7\""
Sep 06 12:36:34.385131 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.384536    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:34.385131 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.384541    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"]
Sep 06 12:36:34.511365 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511326    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-socket\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.511551 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511385    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-data\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.511551 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-certs\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.511551 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511450    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-envoy\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.511746 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-istio-token\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.511746 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511580    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63277d5-9233-4435-9580-262c39bb2200-istiod-ca-cert\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.511746 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511676    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-credential-socket\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.511746 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63277d5-9233-4435-9580-262c39bb2200-istio-podinfo\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.511746 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.511737    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvvbx\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-kube-api-access-nvvbx\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-istio-token\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612346    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63277d5-9233-4435-9580-262c39bb2200-istiod-ca-cert\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-credential-socket\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612433    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63277d5-9233-4435-9580-262c39bb2200-istio-podinfo\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvvbx\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-kube-api-access-nvvbx\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-socket\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-data\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-certs\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612923 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-envoy\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.612973 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612954    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-socket\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.613034 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.612954    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-data\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.613102 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.613080    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-certs\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.613160 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.613098    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-credential-socket\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.613320 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.613264    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63277d5-9233-4435-9580-262c39bb2200-istiod-ca-cert\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.615044 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.615023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-envoy\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.615175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.615164    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63277d5-9233-4435-9580-262c39bb2200-istio-podinfo\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.620785 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.620759    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvvbx\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-kube-api-access-nvvbx\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.620916 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.620895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-istio-token\") pod \"e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") " pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.634936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.634879    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:34.691790 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.691766    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:34.969528 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.969501    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"]
Sep 06 12:36:34.971126 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:36:34.971099    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63277d5_9233_4435_9580_262c39bb2200.slice/crio-679541647aa73d1fecde65de03df17f14ad2fa7250af5527eefd7df990ea1307 WatchSource:0}: Error finding container 679541647aa73d1fecde65de03df17f14ad2fa7250af5527eefd7df990ea1307: Status 404 returned error can't find the container with id 679541647aa73d1fecde65de03df17f14ad2fa7250af5527eefd7df990ea1307
Sep 06 12:36:34.973657 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.973626    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:34.973757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.973703    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:34.973757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:34.973746    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:35.257665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:35.257572    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:36:35.308300 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:35.308245    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" event={"ID":"e63277d5-9233-4435-9580-262c39bb2200","Type":"ContainerStarted","Data":"af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691"}
Sep 06 12:36:35.308487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:35.308331    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" event={"ID":"e63277d5-9233-4435-9580-262c39bb2200","Type":"ContainerStarted","Data":"679541647aa73d1fecde65de03df17f14ad2fa7250af5527eefd7df990ea1307"}
Sep 06 12:36:35.326336 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:35.326289    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" podStartSLOduration=1.32627504 podStartE2EDuration="1.32627504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:36:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:36:35.324087953 +0000 UTC m=+1135.298135137" watchObservedRunningTime="2026-09-06 12:36:35.32627504 +0000 UTC m=+1135.300322288"
Sep 06 12:36:35.692638 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:35.692585    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:36.697187 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:36.697158    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:37.275164 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:37.275125    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:37.276737 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:37.276711    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 12:36:37.276860 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:37.276768    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 12:36:37.319555 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:37.319527    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:37.320464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:37.320441    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:37.363484 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:37.363449    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:38.325858 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.325825    2568 generic.go:356] "Generic (PLEG): container finished" podID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerID="3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983" exitCode=0
Sep 06 12:36:38.326235 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.325897    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" event={"ID":"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6","Type":"ContainerDied","Data":"3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983"}
Sep 06 12:36:38.326278 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.326266    2568 scope.go:117] "RemoveContainer" containerID="3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983"
Sep 06 12:36:38.327378 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.327353    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:38.327487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.327416    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:38.327487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.327447    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:38.403429 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.403383    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:38.503955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.503918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:38.603745 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.603664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:38.878633 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.878542    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:38.962182 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:38.962144    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:39.332681 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:39.332648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" event={"ID":"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6","Type":"ContainerStarted","Data":"012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480"}
Sep 06 12:36:39.861678 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:39.861573    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:39.862538 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:39.862239    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 12:36:39.862538 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:39.862292    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 12:36:40.861662 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:40.861544    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 12:36:40.862123 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:40.861666    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 12:36:41.862130 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:41.862093    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 12:36:41.862750 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:41.862718    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 12:36:42.862347 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:42.861904    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 12:36:42.862347 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:42.861967    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 12:36:43.277290 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:43.277255    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:43.862040 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:43.861982    2568 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 12:36:43.862357 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:43.862324    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 12:36:44.865436 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:44.865408    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:44.865856 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:44.865725    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:44.866342 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:44.866322    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:36:46.048260 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:46.048227    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:49.004811 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.004777    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"]
Sep 06 12:36:49.009543 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.009523    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.012341 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.012318    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3feb92\"/\"kube-root-ca.crt\""
Sep 06 12:36:49.012341 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.012334    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3feb92\"/\"openshift-service-ca.crt\""
Sep 06 12:36:49.012519 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.012458    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3feb92\"/\"auth-test-model-3feb92-kserve-self-signed-certs\""
Sep 06 12:36:49.012591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.012563    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3feb92\"/\"default-dockercfg-khfhg\""
Sep 06 12:36:49.019124 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.019101    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"]
Sep 06 12:36:49.036807 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.036779    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:49.167253 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.167210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-dshm\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.167430 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.167264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5gjs\" (UniqueName: \"kubernetes.io/projected/2a278672-6717-4c31-b232-66a417e0e802-kube-api-access-b5gjs\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.167430 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.167315    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-tmp-dir\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.167430 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.167342    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-home\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.167639 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.167434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-model-cache\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.167639 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.167463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a278672-6717-4c31-b232-66a417e0e802-tls-certs\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.267874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.267807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-model-cache\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.267874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.267838    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a278672-6717-4c31-b232-66a417e0e802-tls-certs\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.267874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.267868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-dshm\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.268106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.268006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5gjs\" (UniqueName: \"kubernetes.io/projected/2a278672-6717-4c31-b232-66a417e0e802-kube-api-access-b5gjs\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.268106 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.268074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-tmp-dir\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.268217 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.268105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-home\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.268217 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.268176    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-model-cache\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.268409 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.268386    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-tmp-dir\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.268483 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.268421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-home\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.270765 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.270744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-dshm\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.271166 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.271143    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a278672-6717-4c31-b232-66a417e0e802-tls-certs\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.276436 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.276416    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5gjs\" (UniqueName: \"kubernetes.io/projected/2a278672-6717-4c31-b232-66a417e0e802-kube-api-access-b5gjs\") pod \"auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.319407 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.319377    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:49.613255 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:49.613232    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"]
Sep 06 12:36:49.615018 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:36:49.614987    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a278672_6717_4c31_b232_66a417e0e802.slice/crio-cc59aba318dfb50aa944dfc101fd04bb996f1ef60e5c063822bec6e890897a8f WatchSource:0}: Error finding container cc59aba318dfb50aa944dfc101fd04bb996f1ef60e5c063822bec6e890897a8f: Status 404 returned error can't find the container with id cc59aba318dfb50aa944dfc101fd04bb996f1ef60e5c063822bec6e890897a8f
Sep 06 12:36:50.394714 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:50.394685    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf" event={"ID":"2a278672-6717-4c31-b232-66a417e0e802","Type":"ContainerStarted","Data":"d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b"}
Sep 06 12:36:50.395099 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:50.394723    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf" event={"ID":"2a278672-6717-4c31-b232-66a417e0e802","Type":"ContainerStarted","Data":"cc59aba318dfb50aa944dfc101fd04bb996f1ef60e5c063822bec6e890897a8f"}
Sep 06 12:36:50.419629 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:50.417665    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf" podStartSLOduration=2.417645172 podStartE2EDuration="2.417645172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:36:50.415917758 +0000 UTC m=+1150.389964942" watchObservedRunningTime="2026-09-06 12:36:50.417645172 +0000 UTC m=+1150.391692359"
Sep 06 12:36:55.424656 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:55.424571    2568 generic.go:356] "Generic (PLEG): container finished" podID="e63277d5-9233-4435-9580-262c39bb2200" containerID="af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691" exitCode=0
Sep 06 12:36:55.424656 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:55.424645    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" event={"ID":"e63277d5-9233-4435-9580-262c39bb2200","Type":"ContainerDied","Data":"af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691"}
Sep 06 12:36:55.425073 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:55.425054    2568 scope.go:117] "RemoveContainer" containerID="af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691"
Sep 06 12:36:55.426151 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:55.426123    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:55.426242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:55.426205    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:55.426242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:55.426239    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:36:56.431464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:56.431425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" event={"ID":"e63277d5-9233-4435-9580-262c39bb2200","Type":"ContainerStarted","Data":"b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09"}
Sep 06 12:36:56.692469 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:56.692420    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:36:56.692839 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:56.692808    2568 patch_prober.go:28] interesting pod/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 06 12:36:56.693002 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:56.692888    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 06 12:36:57.692408 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:57.692372    2568 patch_prober.go:28] interesting pod/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 06 12:36:57.692804 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:57.692429    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 06 12:36:58.692587 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:58.692551    2568 patch_prober.go:28] interesting pod/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 06 12:36:58.693011 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:58.692644    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 06 12:36:59.319837 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:59.319800    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:59.320048 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:59.319876    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:59.332320 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:59.332293    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:59.378919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:59.378890    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:36:59.480470 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:59.480441    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:36:59.692629 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:59.692589    2568 patch_prober.go:28] interesting pod/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 06 12:36:59.692999 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:36:59.692657    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 06 12:37:00.692359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:00.692328    2568 patch_prober.go:28] interesting pod/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 06 12:37:00.692542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:00.692378    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 06 12:37:01.692307 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:01.692231    2568 patch_prober.go:28] interesting pod/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 06 12:37:01.692307 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:01.692297    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 06 12:37:02.117507 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:02.117400    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:37:02.696292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:02.696263    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:37:02.696689 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:02.696537    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:37:02.697177 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:02.697162    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:37:09.903023 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.902991    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"]
Sep 06 12:37:09.906316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.906301    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:09.908920 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.908892    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"openshift-service-ca.crt\""
Sep 06 12:37:09.908920 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.908910    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"kube-root-ca.crt\""
Sep 06 12:37:09.908920 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.908897    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"auth-test-model-e6515e-kserve-self-signed-certs\""
Sep 06 12:37:09.909135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.908913    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"default-dockercfg-hxkj9\""
Sep 06 12:37:09.916766 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.916743    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"]
Sep 06 12:37:09.928973 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.928954    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:37:09.948746 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.948723    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76d71cc-78c8-4329-907b-2b0af1c20a66-tls-certs\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:09.948845 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.948774    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-tmp-dir\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:09.948845 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.948800    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-home\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:09.948934 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.948886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-dshm\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:09.948934 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.948910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-model-cache\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:09.949012 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:09.948936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4r4f\" (UniqueName: \"kubernetes.io/projected/a76d71cc-78c8-4329-907b-2b0af1c20a66-kube-api-access-p4r4f\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.049557 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.049527    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-tmp-dir\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.049557 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.049560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-home\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.049736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.049578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-dshm\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.049736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.049619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-model-cache\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.049826 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.049742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4r4f\" (UniqueName: \"kubernetes.io/projected/a76d71cc-78c8-4329-907b-2b0af1c20a66-kube-api-access-p4r4f\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.049882 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.049852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76d71cc-78c8-4329-907b-2b0af1c20a66-tls-certs\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.049958 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.049935    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-tmp-dir\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.050016 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.049975    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-home\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.050016 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.050008    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-model-cache\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.051970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.051948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-dshm\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.052291 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.052273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76d71cc-78c8-4329-907b-2b0af1c20a66-tls-certs\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.059762 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.059740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4r4f\" (UniqueName: \"kubernetes.io/projected/a76d71cc-78c8-4329-907b-2b0af1c20a66-kube-api-access-p4r4f\") pod \"auth-test-model-e6515e-kserve-86d64895f-ww6pr\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.215899 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.215871    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:10.486082 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.486058    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"]
Sep 06 12:37:10.488069 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:37:10.488043    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda76d71cc_78c8_4329_907b_2b0af1c20a66.slice/crio-f2ee9d8e03689d841978d967f95b83db7327e907d8930ccf1fbdeba95f37c264 WatchSource:0}: Error finding container f2ee9d8e03689d841978d967f95b83db7327e907d8930ccf1fbdeba95f37c264: Status 404 returned error can't find the container with id f2ee9d8e03689d841978d967f95b83db7327e907d8930ccf1fbdeba95f37c264
Sep 06 12:37:10.515227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:10.515202    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr" event={"ID":"a76d71cc-78c8-4329-907b-2b0af1c20a66","Type":"ContainerStarted","Data":"f2ee9d8e03689d841978d967f95b83db7327e907d8930ccf1fbdeba95f37c264"}
Sep 06 12:37:11.517340 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:11.517305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr" event={"ID":"a76d71cc-78c8-4329-907b-2b0af1c20a66","Type":"ContainerStarted","Data":"342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f"}
Sep 06 12:37:11.533816 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:11.533767    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr" podStartSLOduration=2.5337510180000002 podStartE2EDuration="2.533751018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:37:11.531059025 +0000 UTC m=+1171.505106209" watchObservedRunningTime="2026-09-06 12:37:11.533751018 +0000 UTC m=+1171.507798202"
Sep 06 12:37:20.216111 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:20.216074    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:20.216592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:20.216126    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:20.228281 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:20.228261    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:20.567801 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:20.567733    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:37:27.842242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:27.842211    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:37:36.904925 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:37:36.904888    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:06.820952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:06.820917    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"]
Sep 06 12:38:06.824440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:06.824423    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"
Sep 06 12:38:06.826378 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:06.826355    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:38:06.826507 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:06.826355    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:38:06.830749 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:06.830725    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"]
Sep 06 12:38:06.903750 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:06.903721    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb6c0e1-36fe-4acc-8b41-52401415c37d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d\" (UID: \"2fb6c0e1-36fe-4acc-8b41-52401415c37d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"
Sep 06 12:38:06.993471 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:06.993437    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:07.004652 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:07.004632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb6c0e1-36fe-4acc-8b41-52401415c37d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d\" (UID: \"2fb6c0e1-36fe-4acc-8b41-52401415c37d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"
Sep 06 12:38:07.005280 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:07.005262    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb6c0e1-36fe-4acc-8b41-52401415c37d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d\" (UID: \"2fb6c0e1-36fe-4acc-8b41-52401415c37d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"
Sep 06 12:38:07.136024 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:07.135955    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"
Sep 06 12:38:07.408912 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:07.408889    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"]
Sep 06 12:38:07.411415 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:38:07.411378    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb6c0e1_36fe_4acc_8b41_52401415c37d.slice/crio-b290804ecc3b70cb8aa55dcaa6b2e3e8c1426b81706478afad31001c758d5056 WatchSource:0}: Error finding container b290804ecc3b70cb8aa55dcaa6b2e3e8c1426b81706478afad31001c758d5056: Status 404 returned error can't find the container with id b290804ecc3b70cb8aa55dcaa6b2e3e8c1426b81706478afad31001c758d5056
Sep 06 12:38:07.784938 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:07.784910    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d" event={"ID":"2fb6c0e1-36fe-4acc-8b41-52401415c37d","Type":"ContainerStarted","Data":"8bad87b1499b41dbc8b4220cfc68d50ff8b8209df50df41fe32a2e756c360e4a"}
Sep 06 12:38:07.785067 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:07.784960    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d" event={"ID":"2fb6c0e1-36fe-4acc-8b41-52401415c37d","Type":"ContainerStarted","Data":"b290804ecc3b70cb8aa55dcaa6b2e3e8c1426b81706478afad31001c758d5056"}
Sep 06 12:38:07.798251 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:07.798208    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d" podStartSLOduration=1.7981931279999999 podStartE2EDuration="1.798193128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:38:07.796686207 +0000 UTC m=+1227.770733389" watchObservedRunningTime="2026-09-06 12:38:07.798193128 +0000 UTC m=+1227.772240316"
Sep 06 12:38:08.791406 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:08.791378    2568 generic.go:356] "Generic (PLEG): container finished" podID="2fb6c0e1-36fe-4acc-8b41-52401415c37d" containerID="8bad87b1499b41dbc8b4220cfc68d50ff8b8209df50df41fe32a2e756c360e4a" exitCode=0
Sep 06 12:38:08.791786 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:08.791464    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d" event={"ID":"2fb6c0e1-36fe-4acc-8b41-52401415c37d","Type":"ContainerDied","Data":"8bad87b1499b41dbc8b4220cfc68d50ff8b8209df50df41fe32a2e756c360e4a"}
Sep 06 12:38:09.937554 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:09.937530    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"
Sep 06 12:38:10.026517 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:10.026490    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb6c0e1-36fe-4acc-8b41-52401415c37d-maas-api-service-ca\") pod \"2fb6c0e1-36fe-4acc-8b41-52401415c37d\" (UID: \"2fb6c0e1-36fe-4acc-8b41-52401415c37d\") "
Sep 06 12:38:10.026860 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:10.026839    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fb6c0e1-36fe-4acc-8b41-52401415c37d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fb6c0e1-36fe-4acc-8b41-52401415c37d" (UID: "2fb6c0e1-36fe-4acc-8b41-52401415c37d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:38:10.127733 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:10.127653    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb6c0e1-36fe-4acc-8b41-52401415c37d-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:38:10.802277 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:10.802199    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"
Sep 06 12:38:10.802277 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:10.802221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d" event={"ID":"2fb6c0e1-36fe-4acc-8b41-52401415c37d","Type":"ContainerDied","Data":"b290804ecc3b70cb8aa55dcaa6b2e3e8c1426b81706478afad31001c758d5056"}
Sep 06 12:38:10.802277 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:10.802276    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b290804ecc3b70cb8aa55dcaa6b2e3e8c1426b81706478afad31001c758d5056"
Sep 06 12:38:22.336851 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:22.336815    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:22.401516 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:22.401476    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:22.459551 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:22.459522    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:22.536855 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:22.536827    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"]
Sep 06 12:38:22.538650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:22.538592    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:22.538861 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:22.538844    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-48920d6f-lhx9d"]
Sep 06 12:38:22.597560 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:22.597406    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:24.514939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:24.514904    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fb6c0e1-36fe-4acc-8b41-52401415c37d" path="/var/lib/kubelet/pods/2fb6c0e1-36fe-4acc-8b41-52401415c37d/volumes"
Sep 06 12:38:25.532546 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:25.532513    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:29.148986 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:29.148947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:29.248746 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:29.248713    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:30.557353 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:30.557298    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:50.755348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:50.755315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:50.851627 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:50.851585    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:51.398978 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:51.398947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:56.949471 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:56.949431    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:57.013523 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:57.013497    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:57.182586 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:57.182546    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"]
Sep 06 12:38:57.182877 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:57.182842    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy" containerID="cri-o://b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09" gracePeriod=30
Sep 06 12:38:57.201643 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:57.201541    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:58.448619 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:58.448562    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:58.548109 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:58.548079    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:58.648031 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:58.647998    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:59.195167 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:59.195132    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:59.287809 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:59.287778    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:38:59.383760 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:38:59.383737    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:00.543298 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:00.543270    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:02.418208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.418188    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:39:02.550523 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550459    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-data\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.550523 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550506    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63277d5-9233-4435-9580-262c39bb2200-istio-podinfo\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.550736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550547    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-envoy\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.550736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550577    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-istio-token\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.550736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550623    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63277d5-9233-4435-9580-262c39bb2200-istiod-ca-cert\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.550908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550729    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-data" (OuterVolumeSpecName: "istio-data") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:02.550908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550751    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvvbx\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-kube-api-access-nvvbx\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.550908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550797    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-credential-socket\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.550908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550845    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-socket\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.550908 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.550887    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-certs\") pod \"e63277d5-9233-4435-9580-262c39bb2200\" (UID: \"e63277d5-9233-4435-9580-262c39bb2200\") "
Sep 06 12:39:02.551194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.551040    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:02.551194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.551053    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e63277d5-9233-4435-9580-262c39bb2200-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:39:02.551194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.551119    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:02.551363 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.551226    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:02.551363 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.551243    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63277d5-9233-4435-9580-262c39bb2200-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:02.551363 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.551268    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:02.551363 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.551284    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:02.551363 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.551296    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:02.553033 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.553000    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-kube-api-access-nvvbx" (OuterVolumeSpecName: "kube-api-access-nvvbx") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "kube-api-access-nvvbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:39:02.553033 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.553010    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-istio-token" (OuterVolumeSpecName: "istio-token") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:39:02.553172 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.553050    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:02.553172 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.553081    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e63277d5-9233-4435-9580-262c39bb2200-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e63277d5-9233-4435-9580-262c39bb2200" (UID: "e63277d5-9233-4435-9580-262c39bb2200"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:39:02.652644 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.652623    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:02.652644 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.652641    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63277d5-9233-4435-9580-262c39bb2200-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:02.652773 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.652649    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63277d5-9233-4435-9580-262c39bb2200-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:02.652773 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.652657    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:02.652773 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:02.652664    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvvbx\" (UniqueName: \"kubernetes.io/projected/e63277d5-9233-4435-9580-262c39bb2200-kube-api-access-nvvbx\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:03.054693 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.054665    2568 generic.go:356] "Generic (PLEG): container finished" podID="e63277d5-9233-4435-9580-262c39bb2200" containerID="b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09" exitCode=0
Sep 06 12:39:03.054826 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.054713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" event={"ID":"e63277d5-9233-4435-9580-262c39bb2200","Type":"ContainerDied","Data":"b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09"}
Sep 06 12:39:03.054826 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.054729    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"
Sep 06 12:39:03.054826 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.054750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49" event={"ID":"e63277d5-9233-4435-9580-262c39bb2200","Type":"ContainerDied","Data":"679541647aa73d1fecde65de03df17f14ad2fa7250af5527eefd7df990ea1307"}
Sep 06 12:39:03.054826 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.054770    2568 scope.go:117] "RemoveContainer" containerID="b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09"
Sep 06 12:39:03.063963 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.063949    2568 scope.go:117] "RemoveContainer" containerID="af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691"
Sep 06 12:39:03.071546 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.071528    2568 scope.go:117] "RemoveContainer" containerID="b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09"
Sep 06 12:39:03.071844 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:39:03.071825    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09\": container with ID starting with b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09 not found: ID does not exist" containerID="b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09"
Sep 06 12:39:03.071903 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.071852    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09"} err="failed to get container status \"b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09\": rpc error: code = NotFound desc = could not find container \"b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09\": container with ID starting with b32b5922f44e3309859c5f96143b5298ec37e6ab39a6cd12e1024503ff05cd09 not found: ID does not exist"
Sep 06 12:39:03.071903 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.071869    2568 scope.go:117] "RemoveContainer" containerID="af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691"
Sep 06 12:39:03.072113 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:39:03.072098    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691\": container with ID starting with af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691 not found: ID does not exist" containerID="af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691"
Sep 06 12:39:03.072148 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.072118    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691"} err="failed to get container status \"af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691\": rpc error: code = NotFound desc = could not find container \"af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691\": container with ID starting with af8787dfb912aff6f2cf7e731dd016e6ed1cd67bedfbab92b11076cae6a23691 not found: ID does not exist"
Sep 06 12:39:03.076554 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.076534    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"]
Sep 06 12:39:03.081542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:03.081518    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-48920d6f-openshift-default-7f7dd95ff6-b4z49"]
Sep 06 12:39:04.514833 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:04.514803    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e63277d5-9233-4435-9580-262c39bb2200" path="/var/lib/kubelet/pods/e63277d5-9233-4435-9580-262c39bb2200/volumes"
Sep 06 12:39:06.109666 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:06.109630    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:06.228683 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:06.228653    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:06.759487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:06.759455    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:12.549709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:12.549671    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:12.609330 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:12.609302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:12.686992 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:12.686959    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:12.789475 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:12.789441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:23.234718 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:23.234679    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:23.456202 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:23.456173    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:32.958779 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:32.958743    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"]
Sep 06 12:39:32.979067 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:32.979038    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:33.922901 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:33.922865    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"]
Sep 06 12:39:33.942282 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:33.942253    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:38.912225 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912194    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"]
Sep 06 12:39:38.912625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912510    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy"
Sep 06 12:39:38.912625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912520    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy"
Sep 06 12:39:38.912625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912530    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb6c0e1-36fe-4acc-8b41-52401415c37d" containerName="revoke-keys"
Sep 06 12:39:38.912625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912536    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb6c0e1-36fe-4acc-8b41-52401415c37d" containerName="revoke-keys"
Sep 06 12:39:38.912625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912546    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy"
Sep 06 12:39:38.912625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912551    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy"
Sep 06 12:39:38.912625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912629    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb6c0e1-36fe-4acc-8b41-52401415c37d" containerName="revoke-keys"
Sep 06 12:39:38.912870 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.912639    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy"
Sep 06 12:39:38.915629 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.915611    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:38.917890 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.917867    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3feb92\"/\"sub-test-model-3feb92-kserve-self-signed-certs\""
Sep 06 12:39:38.925139 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:38.925119    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"]
Sep 06 12:39:39.010246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.010213    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:39.039274 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.039248    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz5p5\" (UniqueName: \"kubernetes.io/projected/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-kube-api-access-vz5p5\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.039376 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.039283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tls-certs\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.039376 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.039304    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-model-cache\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.039462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.039418    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tmp-dir\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.039462 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.039442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-home\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.039536 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.039462    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-dshm\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.140093 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.140050    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tmp-dir\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.140230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.140096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-home\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.140230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.140123    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-dshm\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.140230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.140157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz5p5\" (UniqueName: \"kubernetes.io/projected/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-kube-api-access-vz5p5\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.140230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.140193    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tls-certs\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.140230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.140229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-model-cache\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.140887 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.140803    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-model-cache\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.141096 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.141075    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tmp-dir\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.141509 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.141421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-home\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.143816 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.143791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-dshm\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.144672 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.144640    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tls-certs\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.149910 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.149878    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz5p5\" (UniqueName: \"kubernetes.io/projected/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-kube-api-access-vz5p5\") pod \"sub-test-model-3feb92-kserve-df89fc945-44p7q\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.225352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.225330    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:39.495842 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:39.495774    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"]
Sep 06 12:39:39.498810 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:39:39.498776    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ddc3fb9_ccf0_4df5_869e_abf1ec2746b1.slice/crio-a054862855c139cf60a95b591d0622114843b17d1b97bca2fdcafc1165371c6f WatchSource:0}: Error finding container a054862855c139cf60a95b591d0622114843b17d1b97bca2fdcafc1165371c6f: Status 404 returned error can't find the container with id a054862855c139cf60a95b591d0622114843b17d1b97bca2fdcafc1165371c6f
Sep 06 12:39:40.241176 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:40.241128    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q" event={"ID":"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1","Type":"ContainerStarted","Data":"70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506"}
Sep 06 12:39:40.241642 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:40.241198    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q" event={"ID":"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1","Type":"ContainerStarted","Data":"a054862855c139cf60a95b591d0622114843b17d1b97bca2fdcafc1165371c6f"}
Sep 06 12:39:40.257629 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:40.257568    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q" podStartSLOduration=2.257553867 podStartE2EDuration="2.257553867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:39:40.256352552 +0000 UTC m=+1320.230399736" watchObservedRunningTime="2026-09-06 12:39:40.257553867 +0000 UTC m=+1320.231601051"
Sep 06 12:39:44.342482 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:44.342441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:47.978398 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:47.978360    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf" podUID="2a278672-6717-4c31-b232-66a417e0e802" containerName="main" containerID="cri-o://d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b" gracePeriod=45
Sep 06 12:39:48.228055 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.228034    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:39:48.281135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.281068    2568 generic.go:356] "Generic (PLEG): container finished" podID="2a278672-6717-4c31-b232-66a417e0e802" containerID="d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b" exitCode=0
Sep 06 12:39:48.281135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.281109    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"
Sep 06 12:39:48.281297 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.281154    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf" event={"ID":"2a278672-6717-4c31-b232-66a417e0e802","Type":"ContainerDied","Data":"d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b"}
Sep 06 12:39:48.281297 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.281191    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf" event={"ID":"2a278672-6717-4c31-b232-66a417e0e802","Type":"ContainerDied","Data":"cc59aba318dfb50aa944dfc101fd04bb996f1ef60e5c063822bec6e890897a8f"}
Sep 06 12:39:48.281297 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.281206    2568 scope.go:117] "RemoveContainer" containerID="d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b"
Sep 06 12:39:48.289423 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.289408    2568 scope.go:117] "RemoveContainer" containerID="d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b"
Sep 06 12:39:48.289779 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:39:48.289760    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b\": container with ID starting with d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b not found: ID does not exist" containerID="d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b"
Sep 06 12:39:48.289865 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.289787    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b"} err="failed to get container status \"d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b\": rpc error: code = NotFound desc = could not find container \"d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b\": container with ID starting with d32dc9c729906abd05b716abb2070913705ea02d42efba2126874461a0e6f42b not found: ID does not exist"
Sep 06 12:39:48.317122 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317101    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-model-cache\") pod \"2a278672-6717-4c31-b232-66a417e0e802\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") "
Sep 06 12:39:48.317183 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317133    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-home\") pod \"2a278672-6717-4c31-b232-66a417e0e802\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") "
Sep 06 12:39:48.317183 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317172    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5gjs\" (UniqueName: \"kubernetes.io/projected/2a278672-6717-4c31-b232-66a417e0e802-kube-api-access-b5gjs\") pod \"2a278672-6717-4c31-b232-66a417e0e802\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") "
Sep 06 12:39:48.317249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317211    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-dshm\") pod \"2a278672-6717-4c31-b232-66a417e0e802\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") "
Sep 06 12:39:48.317286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317275    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a278672-6717-4c31-b232-66a417e0e802-tls-certs\") pod \"2a278672-6717-4c31-b232-66a417e0e802\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") "
Sep 06 12:39:48.317340 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317300    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-tmp-dir\") pod \"2a278672-6717-4c31-b232-66a417e0e802\" (UID: \"2a278672-6717-4c31-b232-66a417e0e802\") "
Sep 06 12:39:48.317394 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317348    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a278672-6717-4c31-b232-66a417e0e802" (UID: "2a278672-6717-4c31-b232-66a417e0e802"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:48.317394 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317366    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-home" (OuterVolumeSpecName: "home") pod "2a278672-6717-4c31-b232-66a417e0e802" (UID: "2a278672-6717-4c31-b232-66a417e0e802"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:48.317619 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317575    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a278672-6717-4c31-b232-66a417e0e802" (UID: "2a278672-6717-4c31-b232-66a417e0e802"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:48.317780 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317687    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:48.317780 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317702    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:48.317780 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.317711    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:48.319373 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.319351    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-dshm" (OuterVolumeSpecName: "dshm") pod "2a278672-6717-4c31-b232-66a417e0e802" (UID: "2a278672-6717-4c31-b232-66a417e0e802"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:48.319539 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.319521    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a278672-6717-4c31-b232-66a417e0e802-kube-api-access-b5gjs" (OuterVolumeSpecName: "kube-api-access-b5gjs") pod "2a278672-6717-4c31-b232-66a417e0e802" (UID: "2a278672-6717-4c31-b232-66a417e0e802"). InnerVolumeSpecName "kube-api-access-b5gjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:39:48.319622 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.319518    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a278672-6717-4c31-b232-66a417e0e802-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a278672-6717-4c31-b232-66a417e0e802" (UID: "2a278672-6717-4c31-b232-66a417e0e802"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:39:48.418885 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.418861    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5gjs\" (UniqueName: \"kubernetes.io/projected/2a278672-6717-4c31-b232-66a417e0e802-kube-api-access-b5gjs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:48.418885 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.418881    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a278672-6717-4c31-b232-66a417e0e802-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:48.419003 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.418890    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a278672-6717-4c31-b232-66a417e0e802-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:48.596474 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.596419    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"]
Sep 06 12:39:48.599736 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.599717    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/auth-test-model-3feb92-kserve-7ccf4bbb75-ckjsf"]
Sep 06 12:39:48.942914 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:48.942879    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr" podUID="a76d71cc-78c8-4329-907b-2b0af1c20a66" containerName="main" containerID="cri-o://342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f" gracePeriod=45
Sep 06 12:39:49.194635 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.194557    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:39:49.226423 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.226397    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:49.226533 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.226449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:49.238970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.238948    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:49.286869 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.286844    2568 generic.go:356] "Generic (PLEG): container finished" podID="a76d71cc-78c8-4329-907b-2b0af1c20a66" containerID="342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f" exitCode=0
Sep 06 12:39:49.286996 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.286896    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"
Sep 06 12:39:49.286996 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.286936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr" event={"ID":"a76d71cc-78c8-4329-907b-2b0af1c20a66","Type":"ContainerDied","Data":"342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f"}
Sep 06 12:39:49.286996 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.286975    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr" event={"ID":"a76d71cc-78c8-4329-907b-2b0af1c20a66","Type":"ContainerDied","Data":"f2ee9d8e03689d841978d967f95b83db7327e907d8930ccf1fbdeba95f37c264"}
Sep 06 12:39:49.286996 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.286995    2568 scope.go:117] "RemoveContainer" containerID="342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f"
Sep 06 12:39:49.295339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.295320    2568 scope.go:117] "RemoveContainer" containerID="342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f"
Sep 06 12:39:49.295632 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:39:49.295609    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f\": container with ID starting with 342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f not found: ID does not exist" containerID="342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f"
Sep 06 12:39:49.295685 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.295640    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f"} err="failed to get container status \"342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f\": rpc error: code = NotFound desc = could not find container \"342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f\": container with ID starting with 342a90152aa5dd172694ae645a56e48cef35aaca6ae17b8df0b182a3854d079f not found: ID does not exist"
Sep 06 12:39:49.299700 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.299683    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:39:49.327834 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.327813    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-home\") pod \"a76d71cc-78c8-4329-907b-2b0af1c20a66\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") "
Sep 06 12:39:49.327955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.327853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4r4f\" (UniqueName: \"kubernetes.io/projected/a76d71cc-78c8-4329-907b-2b0af1c20a66-kube-api-access-p4r4f\") pod \"a76d71cc-78c8-4329-907b-2b0af1c20a66\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") "
Sep 06 12:39:49.327955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.327903    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-tmp-dir\") pod \"a76d71cc-78c8-4329-907b-2b0af1c20a66\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") "
Sep 06 12:39:49.327955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.327951    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-dshm\") pod \"a76d71cc-78c8-4329-907b-2b0af1c20a66\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") "
Sep 06 12:39:49.328129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.328026    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-model-cache\") pod \"a76d71cc-78c8-4329-907b-2b0af1c20a66\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") "
Sep 06 12:39:49.328129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.328061    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76d71cc-78c8-4329-907b-2b0af1c20a66-tls-certs\") pod \"a76d71cc-78c8-4329-907b-2b0af1c20a66\" (UID: \"a76d71cc-78c8-4329-907b-2b0af1c20a66\") "
Sep 06 12:39:49.328129 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.328070    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-home" (OuterVolumeSpecName: "home") pod "a76d71cc-78c8-4329-907b-2b0af1c20a66" (UID: "a76d71cc-78c8-4329-907b-2b0af1c20a66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:49.328296 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.328156    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a76d71cc-78c8-4329-907b-2b0af1c20a66" (UID: "a76d71cc-78c8-4329-907b-2b0af1c20a66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:49.328296 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.328234    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-model-cache" (OuterVolumeSpecName: "model-cache") pod "a76d71cc-78c8-4329-907b-2b0af1c20a66" (UID: "a76d71cc-78c8-4329-907b-2b0af1c20a66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:49.328402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.328361    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:49.328402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.328379    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:49.328402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.328391    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:49.330408 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.330378    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76d71cc-78c8-4329-907b-2b0af1c20a66-kube-api-access-p4r4f" (OuterVolumeSpecName: "kube-api-access-p4r4f") pod "a76d71cc-78c8-4329-907b-2b0af1c20a66" (UID: "a76d71cc-78c8-4329-907b-2b0af1c20a66"). InnerVolumeSpecName "kube-api-access-p4r4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:39:49.330787 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.330767    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a76d71cc-78c8-4329-907b-2b0af1c20a66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a76d71cc-78c8-4329-907b-2b0af1c20a66" (UID: "a76d71cc-78c8-4329-907b-2b0af1c20a66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:39:49.330787 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.330776    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-dshm" (OuterVolumeSpecName: "dshm") pod "a76d71cc-78c8-4329-907b-2b0af1c20a66" (UID: "a76d71cc-78c8-4329-907b-2b0af1c20a66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:39:49.429477 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.429453    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4r4f\" (UniqueName: \"kubernetes.io/projected/a76d71cc-78c8-4329-907b-2b0af1c20a66-kube-api-access-p4r4f\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:49.429477 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.429476    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76d71cc-78c8-4329-907b-2b0af1c20a66-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:49.429751 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.429493    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76d71cc-78c8-4329-907b-2b0af1c20a66-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:39:49.608291 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.608265    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"]
Sep 06 12:39:49.611797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:49.611776    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/auth-test-model-e6515e-kserve-86d64895f-ww6pr"]
Sep 06 12:39:50.275584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.275556    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:50.376071 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.376048    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:50.514579 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.514552    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a278672-6717-4c31-b232-66a417e0e802" path="/var/lib/kubelet/pods/2a278672-6717-4c31-b232-66a417e0e802/volumes"
Sep 06 12:39:50.514939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.514924    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76d71cc-78c8-4329-907b-2b0af1c20a66" path="/var/lib/kubelet/pods/a76d71cc-78c8-4329-907b-2b0af1c20a66/volumes"
Sep 06 12:39:50.611230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.611176    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:50.879115 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.879051    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"]
Sep 06 12:39:50.879555 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.879541    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a278672-6717-4c31-b232-66a417e0e802" containerName="main"
Sep 06 12:39:50.879609 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.879560    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a278672-6717-4c31-b232-66a417e0e802" containerName="main"
Sep 06 12:39:50.879609 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.879587    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76d71cc-78c8-4329-907b-2b0af1c20a66" containerName="main"
Sep 06 12:39:50.879680 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.879611    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76d71cc-78c8-4329-907b-2b0af1c20a66" containerName="main"
Sep 06 12:39:50.879711 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.879686    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a278672-6717-4c31-b232-66a417e0e802" containerName="main"
Sep 06 12:39:50.879711 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.879699    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a76d71cc-78c8-4329-907b-2b0af1c20a66" containerName="main"
Sep 06 12:39:50.879771 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.879711    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63277d5-9233-4435-9580-262c39bb2200" containerName="istio-proxy"
Sep 06 12:39:50.884193 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.884177    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:50.886186 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.886164    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a898e1-openshift-default-dockercfg-glvz2\""
Sep 06 12:39:50.893959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.893938    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"]
Sep 06 12:39:50.914077 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:50.914050    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:51.044174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044140    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-podinfo\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.044174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-socket\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.044439 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxnrg\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-kube-api-access-wxnrg\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.044439 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-credential-socket\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.044439 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-data\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.044439 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istiod-ca-cert\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.044439 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044411    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-token\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.044744 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044447    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-certs\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.044744 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.044492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-envoy\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145381    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-data\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istiod-ca-cert\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-token\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-certs\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-envoy\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-podinfo\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145591    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-socket\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnrg\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-kube-api-access-wxnrg\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145985 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-credential-socket\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.145985 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-data\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.146087 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.145991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-certs\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.146199 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.146172    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-socket\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.146274 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.146258    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-credential-socket\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.146707 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.146686    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istiod-ca-cert\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.148039 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.148019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-envoy\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.148163 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.148108    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-podinfo\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.152712 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.152693    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-token\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.152943 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.152928    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxnrg\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-kube-api-access-wxnrg\") pod \"e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") " pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.195918 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.195897    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:51.276498 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.276457    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:51.472027 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.472004    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"]
Sep 06 12:39:51.473775 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:39:51.473748    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e7bc4a_cf2f_4b2d_aadd_72299e61f26b.slice/crio-52e3e46f9bb78db8868f3fcd601984a07e81d8774d4e2af6d2bf821c57039798 WatchSource:0}: Error finding container 52e3e46f9bb78db8868f3fcd601984a07e81d8774d4e2af6d2bf821c57039798: Status 404 returned error can't find the container with id 52e3e46f9bb78db8868f3fcd601984a07e81d8774d4e2af6d2bf821c57039798
Sep 06 12:39:51.475897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.475869    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:39:51.475963 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.475933    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:39:51.476015 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:51.475980    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:39:52.305721 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:52.305691    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" event={"ID":"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b","Type":"ContainerStarted","Data":"cf3065b7cd80a51eb440e2f88938ac6f6e15e15e4039bd7ea3c048a6baf84e1f"}
Sep 06 12:39:52.306117 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:52.305741    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" event={"ID":"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b","Type":"ContainerStarted","Data":"52e3e46f9bb78db8868f3fcd601984a07e81d8774d4e2af6d2bf821c57039798"}
Sep 06 12:39:52.324326 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:52.324272    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" podStartSLOduration=2.324251905 podStartE2EDuration="2.324251905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:39:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:39:52.323842152 +0000 UTC m=+1332.297889339" watchObservedRunningTime="2026-09-06 12:39:52.324251905 +0000 UTC m=+1332.298299090"
Sep 06 12:39:53.196898 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:53.196870    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:53.202388 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:53.202366    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:53.310655 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:53.310630    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:53.311416 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:53.311399    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:39:54.201053 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:54.201017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:54.299511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:54.299482    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:55.352983 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:55.352947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:55.453420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:55.453386    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:55.933193 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:55.933160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:56.029321 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:56.029288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:39:56.152053 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:39:56.152017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:15.421889 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:15.421827    2568 generic.go:356] "Generic (PLEG): container finished" podID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerID="cf3065b7cd80a51eb440e2f88938ac6f6e15e15e4039bd7ea3c048a6baf84e1f" exitCode=0
Sep 06 12:40:15.422264 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:15.421890    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" event={"ID":"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b","Type":"ContainerDied","Data":"cf3065b7cd80a51eb440e2f88938ac6f6e15e15e4039bd7ea3c048a6baf84e1f"}
Sep 06 12:40:15.422264 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:15.422225    2568 scope.go:117] "RemoveContainer" containerID="cf3065b7cd80a51eb440e2f88938ac6f6e15e15e4039bd7ea3c048a6baf84e1f"
Sep 06 12:40:15.423292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:15.423264    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:40:15.423350 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:15.423341    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:40:15.423385 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:15.423377    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"}
Sep 06 12:40:16.429169 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:16.429134    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" event={"ID":"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b","Type":"ContainerStarted","Data":"07a92393d87ae868a7014c0520d605a7f2b5ecf741ea2e57e96c48645918ac04"}
Sep 06 12:40:17.196309 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:17.196265    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:40:17.196528 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:17.196433    2568 patch_prober.go:28] interesting pod/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:40:17.196528 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:17.196484    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 06 12:40:18.196415 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.196360    2568 patch_prober.go:28] interesting pod/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:40:18.196905 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.196438    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 06 12:40:18.218026 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.217999    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"]
Sep 06 12:40:18.221379 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.221362    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.223687 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.223672    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"default-dockercfg-hxkj9\""
Sep 06 12:40:18.224625 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.224583    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"sub-test-model-e6515e-kserve-self-signed-certs\""
Sep 06 12:40:18.224709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.224623    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"kube-root-ca.crt\""
Sep 06 12:40:18.224709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.224631    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"openshift-service-ca.crt\""
Sep 06 12:40:18.235508 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.235488    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"]
Sep 06 12:40:18.268255 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.268204    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:18.279634 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.279558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-dshm\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.279634 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.279593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fb4180-4e67-428f-8663-d1b9697a79f2-tls-certs\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.279781 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.279661    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-model-cache\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.279781 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.279718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-tmp-dir\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.279781 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.279741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8h2k\" (UniqueName: \"kubernetes.io/projected/d4fb4180-4e67-428f-8663-d1b9697a79f2-kube-api-access-h8h2k\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.279883 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.279831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-home\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.380844 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.380794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-home\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.381209 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.381034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-dshm\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.381209 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.381104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fb4180-4e67-428f-8663-d1b9697a79f2-tls-certs\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.381209 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.381151    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-model-cache\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.381209 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.381206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-tmp-dir\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.381452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.381231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-home\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.381452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.381239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8h2k\" (UniqueName: \"kubernetes.io/projected/d4fb4180-4e67-428f-8663-d1b9697a79f2-kube-api-access-h8h2k\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.381892 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.381846    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-tmp-dir\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.382059 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.381955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-model-cache\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.383942 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.383917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-dshm\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.383942 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.383939    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fb4180-4e67-428f-8663-d1b9697a79f2-tls-certs\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.389467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.389449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8h2k\" (UniqueName: \"kubernetes.io/projected/d4fb4180-4e67-428f-8663-d1b9697a79f2-kube-api-access-h8h2k\") pod \"sub-test-model-e6515e-kserve-69f597fbd9-mb2ht\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.530289 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.530214    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:18.830931 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:18.830905    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"]
Sep 06 12:40:18.832701 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:40:18.832660    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4fb4180_4e67_428f_8663_d1b9697a79f2.slice/crio-2b5a34b7be305a73911bcf2c59302c9ec57b19c19a9b44978ecfd2e77037acdd WatchSource:0}: Error finding container 2b5a34b7be305a73911bcf2c59302c9ec57b19c19a9b44978ecfd2e77037acdd: Status 404 returned error can't find the container with id 2b5a34b7be305a73911bcf2c59302c9ec57b19c19a9b44978ecfd2e77037acdd
Sep 06 12:40:19.157201 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:19.157110    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:19.196926 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:19.196895    2568 patch_prober.go:28] interesting pod/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:40:19.197248 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:19.196947    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 06 12:40:19.445591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:19.445091    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht" event={"ID":"d4fb4180-4e67-428f-8663-d1b9697a79f2","Type":"ContainerStarted","Data":"7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324"}
Sep 06 12:40:19.445591 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:19.445140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht" event={"ID":"d4fb4180-4e67-428f-8663-d1b9697a79f2","Type":"ContainerStarted","Data":"2b5a34b7be305a73911bcf2c59302c9ec57b19c19a9b44978ecfd2e77037acdd"}
Sep 06 12:40:19.467416 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:19.467356    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht" podStartSLOduration=1.467337438 podStartE2EDuration="1.467337438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:40:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:40:19.465391461 +0000 UTC m=+1359.439438651" watchObservedRunningTime="2026-09-06 12:40:19.467337438 +0000 UTC m=+1359.441384624"
Sep 06 12:40:19.606018 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:19.605975    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:20.011751 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:20.011720    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:20.196344 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:20.196312    2568 patch_prober.go:28] interesting pod/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:40:20.196525 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:20.196366    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 06 12:40:20.454314 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:20.454277    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:21.196626 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:21.196567    2568 patch_prober.go:28] interesting pod/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:40:21.196823 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:21.196655    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 06 12:40:22.201361 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:22.201330    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:40:22.201851 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:22.201731    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:40:22.202944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:22.202927    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:40:22.738629 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:22.738569    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:22.857624 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:22.857569    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:24.066780 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.066749    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:24.174317 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.174281    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:24.370399 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.370296    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:24.569458 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.569426    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:24.683249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.683156    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:24.740039 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.740012    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"]
Sep 06 12:40:24.743446 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.743431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:24.745922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.745902    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-969fdf-dockercfg-ptj8z\""
Sep 06 12:40:24.746227 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.746211    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-969fdf\""
Sep 06 12:40:24.758615 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.758579    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"]
Sep 06 12:40:24.836965 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.836935    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7def2656-212e-444b-a9e8-09aa9d39db0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r\" (UID: \"7def2656-212e-444b-a9e8-09aa9d39db0b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:24.836965 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.836973    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm2df\" (UniqueName: \"kubernetes.io/projected/7def2656-212e-444b-a9e8-09aa9d39db0b-kube-api-access-jm2df\") pod \"payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r\" (UID: \"7def2656-212e-444b-a9e8-09aa9d39db0b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:24.937650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.937532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7def2656-212e-444b-a9e8-09aa9d39db0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r\" (UID: \"7def2656-212e-444b-a9e8-09aa9d39db0b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:24.937650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.937571    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2df\" (UniqueName: \"kubernetes.io/projected/7def2656-212e-444b-a9e8-09aa9d39db0b-kube-api-access-jm2df\") pod \"payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r\" (UID: \"7def2656-212e-444b-a9e8-09aa9d39db0b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:24.938201 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.938180    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7def2656-212e-444b-a9e8-09aa9d39db0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r\" (UID: \"7def2656-212e-444b-a9e8-09aa9d39db0b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:24.948262 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:24.948237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm2df\" (UniqueName: \"kubernetes.io/projected/7def2656-212e-444b-a9e8-09aa9d39db0b-kube-api-access-jm2df\") pod \"payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r\" (UID: \"7def2656-212e-444b-a9e8-09aa9d39db0b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:25.053769 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:25.053743    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:25.327592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:25.327570    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"]
Sep 06 12:40:25.329327 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:40:25.329302    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7def2656_212e_444b_a9e8_09aa9d39db0b.slice/crio-6bf019cccbdff64de5faac80101fb1d41ddc762d17ad7a84f842f7c028a8cc07 WatchSource:0}: Error finding container 6bf019cccbdff64de5faac80101fb1d41ddc762d17ad7a84f842f7c028a8cc07: Status 404 returned error can't find the container with id 6bf019cccbdff64de5faac80101fb1d41ddc762d17ad7a84f842f7c028a8cc07
Sep 06 12:40:25.483258 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:25.483230    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r" event={"ID":"7def2656-212e-444b-a9e8-09aa9d39db0b","Type":"ContainerStarted","Data":"7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121"}
Sep 06 12:40:25.483393 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:25.483282    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r" event={"ID":"7def2656-212e-444b-a9e8-09aa9d39db0b","Type":"ContainerStarted","Data":"6bf019cccbdff64de5faac80101fb1d41ddc762d17ad7a84f842f7c028a8cc07"}
Sep 06 12:40:25.483393 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:25.483306    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:25.503115 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:25.503068    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r" podStartSLOduration=1.5030491910000001 podStartE2EDuration="1.503049191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:40:25.502431451 +0000 UTC m=+1365.476478636" watchObservedRunningTime="2026-09-06 12:40:25.503049191 +0000 UTC m=+1365.477096377"
Sep 06 12:40:28.531330 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:28.531300    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:28.531863 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:28.531349    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:28.543874 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:28.543851    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:29.513868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:29.513843    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:40:36.490790 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:36.490756    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:40:42.682530 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:42.682490    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:47.637028 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:47.636980    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:49.810275 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:49.810235    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:50.527868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.527843    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"]
Sep 06 12:40:50.532722 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.532699    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"
Sep 06 12:40:50.536036 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.536014    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:40:50.536173 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.536087    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:40:50.542385 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.542363    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"]
Sep 06 12:40:50.653213 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.653190    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49478b45-bf9c-4685-8966-a2bf5ae98df9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4\" (UID: \"49478b45-bf9c-4685-8966-a2bf5ae98df9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"
Sep 06 12:40:50.753648 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.753621    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49478b45-bf9c-4685-8966-a2bf5ae98df9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4\" (UID: \"49478b45-bf9c-4685-8966-a2bf5ae98df9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"
Sep 06 12:40:50.754182 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.754165    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49478b45-bf9c-4685-8966-a2bf5ae98df9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4\" (UID: \"49478b45-bf9c-4685-8966-a2bf5ae98df9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"
Sep 06 12:40:50.844919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:50.844866    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"
Sep 06 12:40:51.021266 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:51.021226    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:40:51.126573 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:51.126547    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"]
Sep 06 12:40:51.127703 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:40:51.127678    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49478b45_bf9c_4685_8966_a2bf5ae98df9.slice/crio-03f5e7698edc8190e8d261faab7de3b237f250478f94a23fb7466626447bfd19 WatchSource:0}: Error finding container 03f5e7698edc8190e8d261faab7de3b237f250478f94a23fb7466626447bfd19: Status 404 returned error can't find the container with id 03f5e7698edc8190e8d261faab7de3b237f250478f94a23fb7466626447bfd19
Sep 06 12:40:51.621071 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:51.621044    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4" event={"ID":"49478b45-bf9c-4685-8966-a2bf5ae98df9","Type":"ContainerStarted","Data":"9b641faa456a73ddf9a4b375be8afa8c6de944f51699b5720ae552c3a1dd82f7"}
Sep 06 12:40:51.621200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:51.621087    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4" event={"ID":"49478b45-bf9c-4685-8966-a2bf5ae98df9","Type":"ContainerStarted","Data":"03f5e7698edc8190e8d261faab7de3b237f250478f94a23fb7466626447bfd19"}
Sep 06 12:40:52.630010 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:52.629981    2568 generic.go:356] "Generic (PLEG): container finished" podID="49478b45-bf9c-4685-8966-a2bf5ae98df9" containerID="9b641faa456a73ddf9a4b375be8afa8c6de944f51699b5720ae552c3a1dd82f7" exitCode=0
Sep 06 12:40:52.630397 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:52.630040    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4" event={"ID":"49478b45-bf9c-4685-8966-a2bf5ae98df9","Type":"ContainerDied","Data":"9b641faa456a73ddf9a4b375be8afa8c6de944f51699b5720ae552c3a1dd82f7"}
Sep 06 12:40:53.764901 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:53.764875    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"
Sep 06 12:40:53.883825 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:53.883798    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49478b45-bf9c-4685-8966-a2bf5ae98df9-maas-api-service-ca\") pod \"49478b45-bf9c-4685-8966-a2bf5ae98df9\" (UID: \"49478b45-bf9c-4685-8966-a2bf5ae98df9\") "
Sep 06 12:40:53.884119 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:53.884094    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49478b45-bf9c-4685-8966-a2bf5ae98df9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49478b45-bf9c-4685-8966-a2bf5ae98df9" (UID: "49478b45-bf9c-4685-8966-a2bf5ae98df9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:40:53.984741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:53.984722    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49478b45-bf9c-4685-8966-a2bf5ae98df9-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:40:54.642280 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:54.642254    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"
Sep 06 12:40:54.642421 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:54.642275    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4" event={"ID":"49478b45-bf9c-4685-8966-a2bf5ae98df9","Type":"ContainerDied","Data":"03f5e7698edc8190e8d261faab7de3b237f250478f94a23fb7466626447bfd19"}
Sep 06 12:40:54.642421 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:40:54.642319    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03f5e7698edc8190e8d261faab7de3b237f250478f94a23fb7466626447bfd19"
Sep 06 12:41:06.024897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.024866    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:06.089481 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.089440    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:06.151720 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.151688    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:06.216142 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.216115    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"]
Sep 06 12:41:06.217939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.217916    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:06.219068 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.219050    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a898e1-gfxd4"]
Sep 06 12:41:06.284810 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.284746    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:06.514846 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.514806    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49478b45-bf9c-4685-8966-a2bf5ae98df9" path="/var/lib/kubelet/pods/49478b45-bf9c-4685-8966-a2bf5ae98df9/volumes"
Sep 06 12:41:06.554420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:06.554333    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:11.291851 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:11.291821    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"]
Sep 06 12:41:11.314826 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:11.314793    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:12.405586 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.405547    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"]
Sep 06 12:41:12.409868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.409840    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:12.470027 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.469992    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:12.641245 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.641214    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"]
Sep 06 12:41:12.641490 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.641448    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy" containerID="cri-o://07a92393d87ae868a7014c0520d605a7f2b5ecf741ea2e57e96c48645918ac04" gracePeriod=30
Sep 06 12:41:12.666308 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.666236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:12.971183 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.971150    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"]
Sep 06 12:41:12.971532 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.971519    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49478b45-bf9c-4685-8966-a2bf5ae98df9" containerName="revoke-keys"
Sep 06 12:41:12.971587 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.971534    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="49478b45-bf9c-4685-8966-a2bf5ae98df9" containerName="revoke-keys"
Sep 06 12:41:12.971650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.971621    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="49478b45-bf9c-4685-8966-a2bf5ae98df9" containerName="revoke-keys"
Sep 06 12:41:12.974653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.974636    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"
Sep 06 12:41:12.976654 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.976629    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:41:12.976788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.976675    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:41:12.980256 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:12.980235    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"]
Sep 06 12:41:13.041824 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:13.041790    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62fcad89-700d-464b-8024-ac1a7234b759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-969fdf-slbfb\" (UID: \"62fcad89-700d-464b-8024-ac1a7234b759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"
Sep 06 12:41:13.089004 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:13.088976    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:13.142693 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:13.142669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62fcad89-700d-464b-8024-ac1a7234b759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-969fdf-slbfb\" (UID: \"62fcad89-700d-464b-8024-ac1a7234b759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"
Sep 06 12:41:13.143215 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:13.143194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62fcad89-700d-464b-8024-ac1a7234b759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-969fdf-slbfb\" (UID: \"62fcad89-700d-464b-8024-ac1a7234b759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"
Sep 06 12:41:13.286910 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:13.286828    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"
Sep 06 12:41:13.562279 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:13.562260    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"]
Sep 06 12:41:13.564294 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:41:13.564268    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62fcad89_700d_464b_8024_ac1a7234b759.slice/crio-d1d034258efd7dfff4cdd4d5c209d18b64cd28fbe322e9fed99385730c4088c5 WatchSource:0}: Error finding container d1d034258efd7dfff4cdd4d5c209d18b64cd28fbe322e9fed99385730c4088c5: Status 404 returned error can't find the container with id d1d034258efd7dfff4cdd4d5c209d18b64cd28fbe322e9fed99385730c4088c5
Sep 06 12:41:13.741501 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:13.741476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb" event={"ID":"62fcad89-700d-464b-8024-ac1a7234b759","Type":"ContainerStarted","Data":"d1d034258efd7dfff4cdd4d5c209d18b64cd28fbe322e9fed99385730c4088c5"}
Sep 06 12:41:14.747725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:14.747700    2568 generic.go:356] "Generic (PLEG): container finished" podID="62fcad89-700d-464b-8024-ac1a7234b759" containerID="eac2c27407010ac3149342b49dde6e4d549f5a9244b67ebf1e271f88d2113b42" exitCode=0
Sep 06 12:41:14.748098 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:14.747784    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb" event={"ID":"62fcad89-700d-464b-8024-ac1a7234b759","Type":"ContainerDied","Data":"eac2c27407010ac3149342b49dde6e4d549f5a9244b67ebf1e271f88d2113b42"}
Sep 06 12:41:15.887789 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:15.887767    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"
Sep 06 12:41:15.961135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:15.961101    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:15.968079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:15.968056    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62fcad89-700d-464b-8024-ac1a7234b759-maas-api-service-ca\") pod \"62fcad89-700d-464b-8024-ac1a7234b759\" (UID: \"62fcad89-700d-464b-8024-ac1a7234b759\") "
Sep 06 12:41:15.968420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:15.968399    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62fcad89-700d-464b-8024-ac1a7234b759-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "62fcad89-700d-464b-8024-ac1a7234b759" (UID: "62fcad89-700d-464b-8024-ac1a7234b759"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:16.069207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:16.069131    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62fcad89-700d-464b-8024-ac1a7234b759-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:16.759884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:16.759858    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"
Sep 06 12:41:16.760006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:16.759880    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb" event={"ID":"62fcad89-700d-464b-8024-ac1a7234b759","Type":"ContainerDied","Data":"d1d034258efd7dfff4cdd4d5c209d18b64cd28fbe322e9fed99385730c4088c5"}
Sep 06 12:41:16.760006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:16.759921    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1d034258efd7dfff4cdd4d5c209d18b64cd28fbe322e9fed99385730c4088c5"
Sep 06 12:41:17.202994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.202968    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"]
Sep 06 12:41:17.203494 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.203475    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62fcad89-700d-464b-8024-ac1a7234b759" containerName="revoke-keys"
Sep 06 12:41:17.203643 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.203496    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62fcad89-700d-464b-8024-ac1a7234b759" containerName="revoke-keys"
Sep 06 12:41:17.203643 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.203584    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62fcad89-700d-464b-8024-ac1a7234b759" containerName="revoke-keys"
Sep 06 12:41:17.206821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.206802    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.208852 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.208833    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3feb92\"/\"rate-test-model-3feb92-kserve-self-signed-certs\""
Sep 06 12:41:17.217447 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.217425    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"]
Sep 06 12:41:17.230574 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.230544    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:17.278749 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.278726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018eed55-684d-4282-a489-4764431b7b11-tls-certs\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.278845 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.278787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-dshm\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.278896 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.278849    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-home\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.278939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.278903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-model-cache\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.278939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.278924    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-tmp-dir\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.279005 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.278941    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75f9q\" (UniqueName: \"kubernetes.io/projected/018eed55-684d-4282-a489-4764431b7b11-kube-api-access-75f9q\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379313 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379286    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018eed55-684d-4282-a489-4764431b7b11-tls-certs\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379405 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-dshm\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379405 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-home\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379405 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379390    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-model-cache\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379526 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-tmp-dir\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379526 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75f9q\" (UniqueName: \"kubernetes.io/projected/018eed55-684d-4282-a489-4764431b7b11-kube-api-access-75f9q\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379828 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379810    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-model-cache\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379912 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379844    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-home\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.379912 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.379879    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-tmp-dir\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.381802 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.381780    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-dshm\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.381880 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.381858    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018eed55-684d-4282-a489-4764431b7b11-tls-certs\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.391612 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.391562    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75f9q\" (UniqueName: \"kubernetes.io/projected/018eed55-684d-4282-a489-4764431b7b11-kube-api-access-75f9q\") pod \"rate-test-model-3feb92-kserve-bbf779667-jqbkx\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") " pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.515087 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.515016    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:17.766459 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.766394    2568 generic.go:356] "Generic (PLEG): container finished" podID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerID="07a92393d87ae868a7014c0520d605a7f2b5ecf741ea2e57e96c48645918ac04" exitCode=0
Sep 06 12:41:17.766563 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.766462    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" event={"ID":"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b","Type":"ContainerDied","Data":"07a92393d87ae868a7014c0520d605a7f2b5ecf741ea2e57e96c48645918ac04"}
Sep 06 12:41:17.766563 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.766523    2568 scope.go:117] "RemoveContainer" containerID="cf3065b7cd80a51eb440e2f88938ac6f6e15e15e4039bd7ea3c048a6baf84e1f"
Sep 06 12:41:17.790923 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.790712    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"]
Sep 06 12:41:17.792497 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:41:17.792470    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod018eed55_684d_4282_a489_4764431b7b11.slice/crio-80e61bc92c32158ee503b8c5fb8762f04504290ae5008a741e771259f6fdb348 WatchSource:0}: Error finding container 80e61bc92c32158ee503b8c5fb8762f04504290ae5008a741e771259f6fdb348: Status 404 returned error can't find the container with id 80e61bc92c32158ee503b8c5fb8762f04504290ae5008a741e771259f6fdb348
Sep 06 12:41:17.886356 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.886332    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:41:17.984592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984564    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-envoy\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.984592 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984594    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-data\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.984807 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984679    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxnrg\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-kube-api-access-wxnrg\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.984807 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984733    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istiod-ca-cert\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.984807 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984764    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-socket\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.984807 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984793    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-certs\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.985017 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984863    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-data" (OuterVolumeSpecName: "istio-data") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:17.985017 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984873    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-credential-socket\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.985017 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984920    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-podinfo\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.985017 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.984957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-token\") pod \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\" (UID: \"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b\") "
Sep 06 12:41:17.985212 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985021    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:17.985212 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985073    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:17.985212 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985089    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:17.985212 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985097    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:17.985380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985303    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:17.985380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985317    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:17.985380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985325    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:17.985380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985338    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:17.985380 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.985349    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:17.986897 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.986868    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:17.987115 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.987095    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:41:17.987175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.987145    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-kube-api-access-wxnrg" (OuterVolumeSpecName: "kube-api-access-wxnrg") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "kube-api-access-wxnrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:17.987295 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:17.987276    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-token" (OuterVolumeSpecName: "istio-token") pod "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" (UID: "20e7bc4a-cf2f-4b2d-aadd-72299e61f26b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:18.086686 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.086654    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxnrg\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-kube-api-access-wxnrg\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:18.086686 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.086682    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:18.086686 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.086692    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:18.086835 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.086701    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:18.772396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.772375    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"
Sep 06 12:41:18.772884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.772417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm" event={"ID":"20e7bc4a-cf2f-4b2d-aadd-72299e61f26b","Type":"ContainerDied","Data":"52e3e46f9bb78db8868f3fcd601984a07e81d8774d4e2af6d2bf821c57039798"}
Sep 06 12:41:18.772884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.772477    2568 scope.go:117] "RemoveContainer" containerID="07a92393d87ae868a7014c0520d605a7f2b5ecf741ea2e57e96c48645918ac04"
Sep 06 12:41:18.774176 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.774152    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx" event={"ID":"018eed55-684d-4282-a489-4764431b7b11","Type":"ContainerStarted","Data":"0a759400fd01e72c2ee0a51c903a4e9f96e2861e1b7f94cc91cbde9e4e743dcd"}
Sep 06 12:41:18.774301 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.774187    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx" event={"ID":"018eed55-684d-4282-a489-4764431b7b11","Type":"ContainerStarted","Data":"80e61bc92c32158ee503b8c5fb8762f04504290ae5008a741e771259f6fdb348"}
Sep 06 12:41:18.791174 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.791149    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"]
Sep 06 12:41:18.795371 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.795348    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a898e1-openshift-default-7f896fc6cb-mrmdm"]
Sep 06 12:41:18.810251 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:18.810197    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx" podStartSLOduration=1.810183718 podStartE2EDuration="1.810183718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:41:18.8098073 +0000 UTC m=+1418.783854487" watchObservedRunningTime="2026-09-06 12:41:18.810183718 +0000 UTC m=+1418.784230904"
Sep 06 12:41:19.193851 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:19.193812    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:20.515524 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:20.515495    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" path="/var/lib/kubelet/pods/20e7bc4a-cf2f-4b2d-aadd-72299e61f26b/volumes"
Sep 06 12:41:23.206569 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:23.206535    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:23.316139 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:23.316104    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:26.311863 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.311807    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q" podUID="0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" containerName="main" containerID="cri-o://70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506" gracePeriod=45
Sep 06 12:41:26.564519 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.564457    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:41:26.658965 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.658936    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-model-cache\") pod \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") "
Sep 06 12:41:26.659118 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.658991    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-dshm\") pod \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") "
Sep 06 12:41:26.659118 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.659026    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tls-certs\") pod \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") "
Sep 06 12:41:26.659118 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.659045    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz5p5\" (UniqueName: \"kubernetes.io/projected/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-kube-api-access-vz5p5\") pod \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") "
Sep 06 12:41:26.659118 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.659088    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tmp-dir\") pod \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") "
Sep 06 12:41:26.659118 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.659106    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-home\") pod \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\" (UID: \"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1\") "
Sep 06 12:41:26.659388 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.659200    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" (UID: "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:26.659388 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.659370    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:26.659388 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.659368    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" (UID: "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:26.659510 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.659408    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-home" (OuterVolumeSpecName: "home") pod "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" (UID: "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:26.661241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.661219    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" (UID: "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:41:26.661315 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.661234    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-kube-api-access-vz5p5" (OuterVolumeSpecName: "kube-api-access-vz5p5") pod "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" (UID: "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1"). InnerVolumeSpecName "kube-api-access-vz5p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:26.661315 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.661271    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-dshm" (OuterVolumeSpecName: "dshm") pod "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" (UID: "0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:26.759782 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.759756    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:26.759782 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.759779    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:26.759919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.759793    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz5p5\" (UniqueName: \"kubernetes.io/projected/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-kube-api-access-vz5p5\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:26.759919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.759805    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:26.759919 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.759816    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:26.818250 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.818190    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" containerID="70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506" exitCode=0
Sep 06 12:41:26.818250 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.818231    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"
Sep 06 12:41:26.818372 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.818275    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q" event={"ID":"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1","Type":"ContainerDied","Data":"70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506"}
Sep 06 12:41:26.818372 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.818313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q" event={"ID":"0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1","Type":"ContainerDied","Data":"a054862855c139cf60a95b591d0622114843b17d1b97bca2fdcafc1165371c6f"}
Sep 06 12:41:26.818372 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.818329    2568 scope.go:117] "RemoveContainer" containerID="70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506"
Sep 06 12:41:26.829350 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.829331    2568 scope.go:117] "RemoveContainer" containerID="70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506"
Sep 06 12:41:26.829868 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:41:26.829843    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506\": container with ID starting with 70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506 not found: ID does not exist" containerID="70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506"
Sep 06 12:41:26.829966 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.829872    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506"} err="failed to get container status \"70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506\": rpc error: code = NotFound desc = could not find container \"70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506\": container with ID starting with 70736d03468d2dda61f4699b27f9ec7a6ea6970fad75750ef03d443e9dd74506 not found: ID does not exist"
Sep 06 12:41:26.838742 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.838721    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"]
Sep 06 12:41:26.844514 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:26.844492    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/sub-test-model-3feb92-kserve-df89fc945-44p7q"]
Sep 06 12:41:27.425741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.425710    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht" podUID="d4fb4180-4e67-428f-8663-d1b9697a79f2" containerName="main" containerID="cri-o://7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324" gracePeriod=45
Sep 06 12:41:27.515757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.515734    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:27.515839 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.515770    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:27.527860 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.527837    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:27.668821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.668797    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:41:27.770066 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770033    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-tmp-dir\") pod \"d4fb4180-4e67-428f-8663-d1b9697a79f2\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") "
Sep 06 12:41:27.770066 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770067    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-home\") pod \"d4fb4180-4e67-428f-8663-d1b9697a79f2\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") "
Sep 06 12:41:27.770263 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770092    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-model-cache\") pod \"d4fb4180-4e67-428f-8663-d1b9697a79f2\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") "
Sep 06 12:41:27.770263 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770131    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8h2k\" (UniqueName: \"kubernetes.io/projected/d4fb4180-4e67-428f-8663-d1b9697a79f2-kube-api-access-h8h2k\") pod \"d4fb4180-4e67-428f-8663-d1b9697a79f2\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") "
Sep 06 12:41:27.770263 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-dshm\") pod \"d4fb4180-4e67-428f-8663-d1b9697a79f2\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") "
Sep 06 12:41:27.770263 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770180    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fb4180-4e67-428f-8663-d1b9697a79f2-tls-certs\") pod \"d4fb4180-4e67-428f-8663-d1b9697a79f2\" (UID: \"d4fb4180-4e67-428f-8663-d1b9697a79f2\") "
Sep 06 12:41:27.770469 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770332    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d4fb4180-4e67-428f-8663-d1b9697a79f2" (UID: "d4fb4180-4e67-428f-8663-d1b9697a79f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:27.770469 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770339    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-home" (OuterVolumeSpecName: "home") pod "d4fb4180-4e67-428f-8663-d1b9697a79f2" (UID: "d4fb4180-4e67-428f-8663-d1b9697a79f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:27.770564 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770463    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "d4fb4180-4e67-428f-8663-d1b9697a79f2" (UID: "d4fb4180-4e67-428f-8663-d1b9697a79f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:27.770564 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770525    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:27.770564 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.770550    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:27.772494 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.772472    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-dshm" (OuterVolumeSpecName: "dshm") pod "d4fb4180-4e67-428f-8663-d1b9697a79f2" (UID: "d4fb4180-4e67-428f-8663-d1b9697a79f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:27.772584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.772524    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4fb4180-4e67-428f-8663-d1b9697a79f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d4fb4180-4e67-428f-8663-d1b9697a79f2" (UID: "d4fb4180-4e67-428f-8663-d1b9697a79f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:41:27.772651 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.772628    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4fb4180-4e67-428f-8663-d1b9697a79f2-kube-api-access-h8h2k" (OuterVolumeSpecName: "kube-api-access-h8h2k") pod "d4fb4180-4e67-428f-8663-d1b9697a79f2" (UID: "d4fb4180-4e67-428f-8663-d1b9697a79f2"). InnerVolumeSpecName "kube-api-access-h8h2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:27.827053 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.827030    2568 generic.go:356] "Generic (PLEG): container finished" podID="d4fb4180-4e67-428f-8663-d1b9697a79f2" containerID="7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324" exitCode=0
Sep 06 12:41:27.827149 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.827073    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"
Sep 06 12:41:27.827149 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.827105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht" event={"ID":"d4fb4180-4e67-428f-8663-d1b9697a79f2","Type":"ContainerDied","Data":"7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324"}
Sep 06 12:41:27.827149 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.827136    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht" event={"ID":"d4fb4180-4e67-428f-8663-d1b9697a79f2","Type":"ContainerDied","Data":"2b5a34b7be305a73911bcf2c59302c9ec57b19c19a9b44978ecfd2e77037acdd"}
Sep 06 12:41:27.827265 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.827156    2568 scope.go:117] "RemoveContainer" containerID="7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324"
Sep 06 12:41:27.836057 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.836041    2568 scope.go:117] "RemoveContainer" containerID="7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324"
Sep 06 12:41:27.836321 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:41:27.836300    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324\": container with ID starting with 7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324 not found: ID does not exist" containerID="7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324"
Sep 06 12:41:27.836383 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.836334    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324"} err="failed to get container status \"7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324\": rpc error: code = NotFound desc = could not find container \"7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324\": container with ID starting with 7834eab6352cc28a140fd0e6e0eb6e20747bde140810fa6c9e903c8786eff324 not found: ID does not exist"
Sep 06 12:41:27.839270 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.839243    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:41:27.847697 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.847673    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"]
Sep 06 12:41:27.853757 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.853739    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/sub-test-model-e6515e-kserve-69f597fbd9-mb2ht"]
Sep 06 12:41:27.871868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.871839    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:27.871868 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.871865    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8h2k\" (UniqueName: \"kubernetes.io/projected/d4fb4180-4e67-428f-8663-d1b9697a79f2-kube-api-access-h8h2k\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:27.872033 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.871879    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4fb4180-4e67-428f-8663-d1b9697a79f2-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:27.872033 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:27.871888    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fb4180-4e67-428f-8663-d1b9697a79f2-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:28.515334 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:28.515306    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" path="/var/lib/kubelet/pods/0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1/volumes"
Sep 06 12:41:28.515706 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:28.515686    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4fb4180-4e67-428f-8663-d1b9697a79f2" path="/var/lib/kubelet/pods/d4fb4180-4e67-428f-8663-d1b9697a79f2/volumes"
Sep 06 12:41:28.893690 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:28.893590    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:28.922785 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:28.922757    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"]
Sep 06 12:41:28.922987 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:28.922963    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r" podUID="7def2656-212e-444b-a9e8-09aa9d39db0b" containerName="payload-pre-processing" containerID="cri-o://7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121" gracePeriod=30
Sep 06 12:41:28.994225 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:28.994194    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:29.075274 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.075243    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"]
Sep 06 12:41:29.077675 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.077649    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-969fdf-slbfb"]
Sep 06 12:41:29.078456 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.078429    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:29.138720 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.138687    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:29.176535 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.176517    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:41:29.282246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.282215    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm2df\" (UniqueName: \"kubernetes.io/projected/7def2656-212e-444b-a9e8-09aa9d39db0b-kube-api-access-jm2df\") pod \"7def2656-212e-444b-a9e8-09aa9d39db0b\" (UID: \"7def2656-212e-444b-a9e8-09aa9d39db0b\") "
Sep 06 12:41:29.282410 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.282311    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7def2656-212e-444b-a9e8-09aa9d39db0b-plugins-config-volume\") pod \"7def2656-212e-444b-a9e8-09aa9d39db0b\" (UID: \"7def2656-212e-444b-a9e8-09aa9d39db0b\") "
Sep 06 12:41:29.282692 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.282670    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7def2656-212e-444b-a9e8-09aa9d39db0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7def2656-212e-444b-a9e8-09aa9d39db0b" (UID: "7def2656-212e-444b-a9e8-09aa9d39db0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:29.284419 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.284397    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7def2656-212e-444b-a9e8-09aa9d39db0b-kube-api-access-jm2df" (OuterVolumeSpecName: "kube-api-access-jm2df") pod "7def2656-212e-444b-a9e8-09aa9d39db0b" (UID: "7def2656-212e-444b-a9e8-09aa9d39db0b"). InnerVolumeSpecName "kube-api-access-jm2df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:29.383321 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.383290    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7def2656-212e-444b-a9e8-09aa9d39db0b-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:29.383321 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.383317    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm2df\" (UniqueName: \"kubernetes.io/projected/7def2656-212e-444b-a9e8-09aa9d39db0b-kube-api-access-jm2df\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:29.444294 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.444268    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:29.839059 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.838986    2568 generic.go:356] "Generic (PLEG): container finished" podID="7def2656-212e-444b-a9e8-09aa9d39db0b" containerID="7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121" exitCode=0
Sep 06 12:41:29.839059 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.839020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r" event={"ID":"7def2656-212e-444b-a9e8-09aa9d39db0b","Type":"ContainerDied","Data":"7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121"}
Sep 06 12:41:29.839059 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.839035    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"
Sep 06 12:41:29.839559 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.839087    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r" event={"ID":"7def2656-212e-444b-a9e8-09aa9d39db0b","Type":"ContainerDied","Data":"6bf019cccbdff64de5faac80101fb1d41ddc762d17ad7a84f842f7c028a8cc07"}
Sep 06 12:41:29.839559 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.839122    2568 scope.go:117] "RemoveContainer" containerID="7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121"
Sep 06 12:41:29.847933 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.847917    2568 scope.go:117] "RemoveContainer" containerID="7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121"
Sep 06 12:41:29.848205 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:41:29.848188    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121\": container with ID starting with 7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121 not found: ID does not exist" containerID="7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121"
Sep 06 12:41:29.848252 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.848214    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121"} err="failed to get container status \"7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121\": rpc error: code = NotFound desc = could not find container \"7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121\": container with ID starting with 7e117bfcd195c63c32bcde830ff9315df678fccded75b5b59cfa2583c72ef121 not found: ID does not exist"
Sep 06 12:41:29.859241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.859217    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"]
Sep 06 12:41:29.862653 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:29.862633    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-969fdf-69bf79b68b-bjs7r"]
Sep 06 12:41:30.514297 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:30.514271    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62fcad89-700d-464b-8024-ac1a7234b759" path="/var/lib/kubelet/pods/62fcad89-700d-464b-8024-ac1a7234b759/volumes"
Sep 06 12:41:30.514610 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:30.514586    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7def2656-212e-444b-a9e8-09aa9d39db0b" path="/var/lib/kubelet/pods/7def2656-212e-444b-a9e8-09aa9d39db0b/volumes"
Sep 06 12:41:35.318800 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.318716    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:35.377322 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.377299    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:35.580726 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.580645    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:35.898708 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.898634    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"]
Sep 06 12:41:35.898960 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.898948    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy"
Sep 06 12:41:35.899000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.898963    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy"
Sep 06 12:41:35.899000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.898972    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4fb4180-4e67-428f-8663-d1b9697a79f2" containerName="main"
Sep 06 12:41:35.899000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.898977    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4fb4180-4e67-428f-8663-d1b9697a79f2" containerName="main"
Sep 06 12:41:35.899000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.898982    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7def2656-212e-444b-a9e8-09aa9d39db0b" containerName="payload-pre-processing"
Sep 06 12:41:35.899000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.898988    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7def2656-212e-444b-a9e8-09aa9d39db0b" containerName="payload-pre-processing"
Sep 06 12:41:35.899000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.898995    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" containerName="main"
Sep 06 12:41:35.899000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.899001    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" containerName="main"
Sep 06 12:41:35.899208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.899006    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy"
Sep 06 12:41:35.899208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.899012    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy"
Sep 06 12:41:35.899208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.899060    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy"
Sep 06 12:41:35.899208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.899066    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e7bc4a-cf2f-4b2d-aadd-72299e61f26b" containerName="istio-proxy"
Sep 06 12:41:35.899208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.899074    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ddc3fb9-ccf0-4df5-869e-abf1ec2746b1" containerName="main"
Sep 06 12:41:35.899208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.899080    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7def2656-212e-444b-a9e8-09aa9d39db0b" containerName="payload-pre-processing"
Sep 06 12:41:35.899208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.899085    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4fb4180-4e67-428f-8663-d1b9697a79f2" containerName="main"
Sep 06 12:41:35.903160 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.903144    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"
Sep 06 12:41:35.905097 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.905075    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:41:35.905208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.905134    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:41:35.908921 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:35.908899    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"]
Sep 06 12:41:36.026062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.026038    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:36.033902 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.033881    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1054afc6-197c-4e18-8f96-b37003f87e5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q\" (UID: \"1054afc6-197c-4e18-8f96-b37003f87e5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"
Sep 06 12:41:36.134583 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.134557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1054afc6-197c-4e18-8f96-b37003f87e5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q\" (UID: \"1054afc6-197c-4e18-8f96-b37003f87e5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"
Sep 06 12:41:36.135104 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.135088    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1054afc6-197c-4e18-8f96-b37003f87e5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q\" (UID: \"1054afc6-197c-4e18-8f96-b37003f87e5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"
Sep 06 12:41:36.214875 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.214838    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"
Sep 06 12:41:36.489052 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.489028    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"]
Sep 06 12:41:36.491230 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:41:36.491201    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1054afc6_197c_4e18_8f96_b37003f87e5b.slice/crio-4f0871dacd36f72f4b720aa79fd28910ad7e20d6d1271f67577d6bc394370a67 WatchSource:0}: Error finding container 4f0871dacd36f72f4b720aa79fd28910ad7e20d6d1271f67577d6bc394370a67: Status 404 returned error can't find the container with id 4f0871dacd36f72f4b720aa79fd28910ad7e20d6d1271f67577d6bc394370a67
Sep 06 12:41:36.877759 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.877655    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q" event={"ID":"1054afc6-197c-4e18-8f96-b37003f87e5b","Type":"ContainerStarted","Data":"ea5903be0d98534930f83e00c6a9cb9e241a780ae81c2320279cc2ecf36562dc"}
Sep 06 12:41:36.877759 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.877746    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q" event={"ID":"1054afc6-197c-4e18-8f96-b37003f87e5b","Type":"ContainerStarted","Data":"4f0871dacd36f72f4b720aa79fd28910ad7e20d6d1271f67577d6bc394370a67"}
Sep 06 12:41:36.892399 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:36.892354    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q" podStartSLOduration=1.892340213 podStartE2EDuration="1.892340213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:41:36.890013725 +0000 UTC m=+1436.864060909" watchObservedRunningTime="2026-09-06 12:41:36.892340213 +0000 UTC m=+1436.866387398"
Sep 06 12:41:37.883889 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:37.883859    2568 generic.go:356] "Generic (PLEG): container finished" podID="1054afc6-197c-4e18-8f96-b37003f87e5b" containerID="ea5903be0d98534930f83e00c6a9cb9e241a780ae81c2320279cc2ecf36562dc" exitCode=0
Sep 06 12:41:37.884223 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:37.883914    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q" event={"ID":"1054afc6-197c-4e18-8f96-b37003f87e5b","Type":"ContainerDied","Data":"ea5903be0d98534930f83e00c6a9cb9e241a780ae81c2320279cc2ecf36562dc"}
Sep 06 12:41:39.016623 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:39.016584    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"
Sep 06 12:41:39.160130 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:39.160064    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1054afc6-197c-4e18-8f96-b37003f87e5b-maas-api-service-ca\") pod \"1054afc6-197c-4e18-8f96-b37003f87e5b\" (UID: \"1054afc6-197c-4e18-8f96-b37003f87e5b\") "
Sep 06 12:41:39.160420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:39.160396    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1054afc6-197c-4e18-8f96-b37003f87e5b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1054afc6-197c-4e18-8f96-b37003f87e5b" (UID: "1054afc6-197c-4e18-8f96-b37003f87e5b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:39.261127 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:39.261103    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1054afc6-197c-4e18-8f96-b37003f87e5b-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:39.895239 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:39.895214    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"
Sep 06 12:41:39.895239 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:39.895223    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q" event={"ID":"1054afc6-197c-4e18-8f96-b37003f87e5b","Type":"ContainerDied","Data":"4f0871dacd36f72f4b720aa79fd28910ad7e20d6d1271f67577d6bc394370a67"}
Sep 06 12:41:39.895484 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:39.895265    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f0871dacd36f72f4b720aa79fd28910ad7e20d6d1271f67577d6bc394370a67"
Sep 06 12:41:40.656107 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:40.656076    2568 scope.go:117] "RemoveContainer" containerID="f73ddb3f0990ba75ed3cd9639581a7832541b8800c645dda0ece29573d91c293"
Sep 06 12:41:40.664324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:40.664307    2568 scope.go:117] "RemoveContainer" containerID="ca45a95e74bddaf53ff023587da2d0a9181163de11e965c9a7bce6f4bb0193c2"
Sep 06 12:41:43.925426 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:43.925392    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:46.027831 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:46.027794    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:46.660252 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:46.660210    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:46.725162 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:46.725135    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:46.827472 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:46.827440    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:46.912942 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:46.912863    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:46.924675 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:46.924651    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"]
Sep 06 12:41:46.930098 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:46.930076    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d96501-bjr9q"]
Sep 06 12:41:46.977085 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:46.977063    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:47.290363 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:47.290327    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:48.515208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:48.515172    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1054afc6-197c-4e18-8f96-b37003f87e5b" path="/var/lib/kubelet/pods/1054afc6-197c-4e18-8f96-b37003f87e5b/volumes"
Sep 06 12:41:52.896287 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:52.896252    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:52.996111 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:52.996070    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:53.139936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.139903    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:53.460532 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.460501    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"]
Sep 06 12:41:53.460939 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.460923    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1054afc6-197c-4e18-8f96-b37003f87e5b" containerName="revoke-keys"
Sep 06 12:41:53.460987 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.460941    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1054afc6-197c-4e18-8f96-b37003f87e5b" containerName="revoke-keys"
Sep 06 12:41:53.461027 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.461021    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1054afc6-197c-4e18-8f96-b37003f87e5b" containerName="revoke-keys"
Sep 06 12:41:53.465767 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.465750    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"
Sep 06 12:41:53.467703 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.467681    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:41:53.467810 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.467753    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:41:53.472281 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.472255    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"]
Sep 06 12:41:53.573717 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.573695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:41:53.579886 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.579864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ed3c2-55a8-4225-bdbc-3a9b31d06219-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d\" (UID: \"0c1ed3c2-55a8-4225-bdbc-3a9b31d06219\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"
Sep 06 12:41:53.681269 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.681234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ed3c2-55a8-4225-bdbc-3a9b31d06219-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d\" (UID: \"0c1ed3c2-55a8-4225-bdbc-3a9b31d06219\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"
Sep 06 12:41:53.681857 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.681840    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ed3c2-55a8-4225-bdbc-3a9b31d06219-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d\" (UID: \"0c1ed3c2-55a8-4225-bdbc-3a9b31d06219\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"
Sep 06 12:41:53.778030 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:53.777948    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"
Sep 06 12:41:54.046583 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:54.046513    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"]
Sep 06 12:41:54.050057 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:41:54.050033    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1ed3c2_55a8_4225_bdbc_3a9b31d06219.slice/crio-0321eb4c5d580ccd4b0e533a20463a0f247ef447e3c2c0931b2b2044988199c5 WatchSource:0}: Error finding container 0321eb4c5d580ccd4b0e533a20463a0f247ef447e3c2c0931b2b2044988199c5: Status 404 returned error can't find the container with id 0321eb4c5d580ccd4b0e533a20463a0f247ef447e3c2c0931b2b2044988199c5
Sep 06 12:41:54.971926 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:54.971898    2568 generic.go:356] "Generic (PLEG): container finished" podID="0c1ed3c2-55a8-4225-bdbc-3a9b31d06219" containerID="cb73f96a0de0c0d4956732727012e80f0197be8c0c744d866120d52ffca00cbb" exitCode=0
Sep 06 12:41:54.972054 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:54.971988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d" event={"ID":"0c1ed3c2-55a8-4225-bdbc-3a9b31d06219","Type":"ContainerDied","Data":"cb73f96a0de0c0d4956732727012e80f0197be8c0c744d866120d52ffca00cbb"}
Sep 06 12:41:54.972054 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:54.972043    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d" event={"ID":"0c1ed3c2-55a8-4225-bdbc-3a9b31d06219","Type":"ContainerStarted","Data":"0321eb4c5d580ccd4b0e533a20463a0f247ef447e3c2c0931b2b2044988199c5"}
Sep 06 12:41:56.106438 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:56.106416    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"
Sep 06 12:41:56.203401 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:56.203374    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ed3c2-55a8-4225-bdbc-3a9b31d06219-maas-api-service-ca\") pod \"0c1ed3c2-55a8-4225-bdbc-3a9b31d06219\" (UID: \"0c1ed3c2-55a8-4225-bdbc-3a9b31d06219\") "
Sep 06 12:41:56.203709 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:56.203691    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c1ed3c2-55a8-4225-bdbc-3a9b31d06219-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0c1ed3c2-55a8-4225-bdbc-3a9b31d06219" (UID: "0c1ed3c2-55a8-4225-bdbc-3a9b31d06219"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:56.303982 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:56.303927    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ed3c2-55a8-4225-bdbc-3a9b31d06219-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:41:56.982553 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:56.982525    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"
Sep 06 12:41:56.982768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:56.982569    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d" event={"ID":"0c1ed3c2-55a8-4225-bdbc-3a9b31d06219","Type":"ContainerDied","Data":"0321eb4c5d580ccd4b0e533a20463a0f247ef447e3c2c0931b2b2044988199c5"}
Sep 06 12:41:56.982768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:41:56.982631    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0321eb4c5d580ccd4b0e533a20463a0f247ef447e3c2c0931b2b2044988199c5"
Sep 06 12:42:03.576039 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:03.576004    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:03.943242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:03.943207    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:04.009480 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:04.009437    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:04.071618 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:04.071574    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:04.139720 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:04.139687    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"]
Sep 06 12:42:04.141577 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:04.141558    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-556bc6-rph5d"]
Sep 06 12:42:04.141975 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:04.141950    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:04.203878 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:04.203819    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:04.496613 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:04.496515    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:04.514734 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:04.514708    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1ed3c2-55a8-4225-bdbc-3a9b31d06219" path="/var/lib/kubelet/pods/0c1ed3c2-55a8-4225-bdbc-3a9b31d06219/volumes"
Sep 06 12:42:10.607502 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:10.607467    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:10.669630 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:10.669590    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:10.866997 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:10.866915    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"]
Sep 06 12:42:10.867151 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:10.867127    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy" containerID="cri-o://4389fb3ee12d4ba6ca137939cfc3608e308fa01ccac77d9d1080d06d57f8ce6e" gracePeriod=30
Sep 06 12:42:10.894650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:10.894619    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:16.080422 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.080390    2568 generic.go:356] "Generic (PLEG): container finished" podID="693dc496-927c-427b-a441-739916251ffc" containerID="4389fb3ee12d4ba6ca137939cfc3608e308fa01ccac77d9d1080d06d57f8ce6e" exitCode=0
Sep 06 12:42:16.080866 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.080462    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" event={"ID":"693dc496-927c-427b-a441-739916251ffc","Type":"ContainerDied","Data":"4389fb3ee12d4ba6ca137939cfc3608e308fa01ccac77d9d1080d06d57f8ce6e"}
Sep 06 12:42:16.080866 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.080531    2568 scope.go:117] "RemoveContainer" containerID="f8b88708583539e5761036ca0df7800d97e94f9aaa558f8b8135112a101d89da"
Sep 06 12:42:16.119666 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.119647    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:42:16.161055 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.160981    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-data\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161055 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161036    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/693dc496-927c-427b-a441-739916251ffc-istio-podinfo\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161055 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161055    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-envoy\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161301 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161083    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-socket\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161301 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161131    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlq4w\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-kube-api-access-xlq4w\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161301 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161170    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-certs\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161301 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161228    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-istio-token\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161301 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161263    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/693dc496-927c-427b-a441-739916251ffc-istiod-ca-cert\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161301 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161298    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-credential-socket\") pod \"693dc496-927c-427b-a441-739916251ffc\" (UID: \"693dc496-927c-427b-a441-739916251ffc\") "
Sep 06 12:42:16.161679 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161259    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-data" (OuterVolumeSpecName: "istio-data") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:42:16.161679 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161450    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:42:16.161679 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161663    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:16.161853 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161679    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:42:16.161853 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.161686    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:16.162059 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.162038    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:42:16.162210 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.162175    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693dc496-927c-427b-a441-739916251ffc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:42:16.163396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.163375    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/693dc496-927c-427b-a441-739916251ffc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:42:16.163488 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.163440    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:42:16.163947 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.163922    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-istio-token" (OuterVolumeSpecName: "istio-token") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:42:16.164221 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.164205    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-kube-api-access-xlq4w" (OuterVolumeSpecName: "kube-api-access-xlq4w") pod "693dc496-927c-427b-a441-739916251ffc" (UID: "693dc496-927c-427b-a441-739916251ffc"). InnerVolumeSpecName "kube-api-access-xlq4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:42:16.262774 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.262754    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/693dc496-927c-427b-a441-739916251ffc-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:16.262774 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.262772    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:16.262886 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.262780    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlq4w\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-kube-api-access-xlq4w\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:16.262886 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.262790    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:16.262886 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.262798    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/693dc496-927c-427b-a441-739916251ffc-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:16.262886 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.262805    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/693dc496-927c-427b-a441-739916251ffc-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:16.262886 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:16.262812    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/693dc496-927c-427b-a441-739916251ffc-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:42:17.086373 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:17.086351    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"
Sep 06 12:42:17.086702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:17.086345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl" event={"ID":"693dc496-927c-427b-a441-739916251ffc","Type":"ContainerDied","Data":"2dee8bdefcadfb3b2e3d40fe89699004a25b2fc4c81c71a57ff836318bb23382"}
Sep 06 12:42:17.086702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:17.086513    2568 scope.go:117] "RemoveContainer" containerID="4389fb3ee12d4ba6ca137939cfc3608e308fa01ccac77d9d1080d06d57f8ce6e"
Sep 06 12:42:17.104799 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:17.104778    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"]
Sep 06 12:42:17.108353 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:17.108334    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-556bc6-openshift-default-5776ff759d-nd6gl"]
Sep 06 12:42:18.514929 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:18.514897    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="693dc496-927c-427b-a441-739916251ffc" path="/var/lib/kubelet/pods/693dc496-927c-427b-a441-739916251ffc/volumes"
Sep 06 12:42:37.780262 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:37.780224    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:42:48.977464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:42:48.977428    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:01.214330 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:01.214291    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"]
Sep 06 12:43:01.237149 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:01.237126    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:02.170133 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:02.170097    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:02.588466 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:02.588435    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:02.900287 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:02.900205    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:03.181496 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:03.181399    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:05.746881 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:05.746848    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:05.847618 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:05.847565    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:07.051375 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:07.051338    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:07.155624 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:07.155565    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:07.331701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:07.331572    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:07.680211 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:07.680122    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:07.778940 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:07.778904    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:16.233517 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.233471    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx" podUID="018eed55-684d-4282-a489-4764431b7b11" containerName="main" containerID="cri-o://0a759400fd01e72c2ee0a51c903a4e9f96e2861e1b7f94cc91cbde9e4e743dcd" gracePeriod=45
Sep 06 12:43:16.369219 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.369193    2568 generic.go:356] "Generic (PLEG): container finished" podID="018eed55-684d-4282-a489-4764431b7b11" containerID="0a759400fd01e72c2ee0a51c903a4e9f96e2861e1b7f94cc91cbde9e4e743dcd" exitCode=0
Sep 06 12:43:16.369326 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.369259    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx" event={"ID":"018eed55-684d-4282-a489-4764431b7b11","Type":"ContainerDied","Data":"0a759400fd01e72c2ee0a51c903a4e9f96e2861e1b7f94cc91cbde9e4e743dcd"}
Sep 06 12:43:16.483431 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.483409    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:43:16.517692 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.517631    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-tmp-dir\") pod \"018eed55-684d-4282-a489-4764431b7b11\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") "
Sep 06 12:43:16.517692 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.517673    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-home\") pod \"018eed55-684d-4282-a489-4764431b7b11\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") "
Sep 06 12:43:16.517692 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.517694    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018eed55-684d-4282-a489-4764431b7b11-tls-certs\") pod \"018eed55-684d-4282-a489-4764431b7b11\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") "
Sep 06 12:43:16.517936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.517718    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75f9q\" (UniqueName: \"kubernetes.io/projected/018eed55-684d-4282-a489-4764431b7b11-kube-api-access-75f9q\") pod \"018eed55-684d-4282-a489-4764431b7b11\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") "
Sep 06 12:43:16.517936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.517737    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-dshm\") pod \"018eed55-684d-4282-a489-4764431b7b11\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") "
Sep 06 12:43:16.517936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.517759    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-model-cache\") pod \"018eed55-684d-4282-a489-4764431b7b11\" (UID: \"018eed55-684d-4282-a489-4764431b7b11\") "
Sep 06 12:43:16.517936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.517911    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-home" (OuterVolumeSpecName: "home") pod "018eed55-684d-4282-a489-4764431b7b11" (UID: "018eed55-684d-4282-a489-4764431b7b11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:43:16.517936 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.517924    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "018eed55-684d-4282-a489-4764431b7b11" (UID: "018eed55-684d-4282-a489-4764431b7b11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:43:16.518218 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.518065    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-model-cache" (OuterVolumeSpecName: "model-cache") pod "018eed55-684d-4282-a489-4764431b7b11" (UID: "018eed55-684d-4282-a489-4764431b7b11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:43:16.518218 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.518085    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:43:16.518218 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.518103    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:43:16.519827 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.519805    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018eed55-684d-4282-a489-4764431b7b11-kube-api-access-75f9q" (OuterVolumeSpecName: "kube-api-access-75f9q") pod "018eed55-684d-4282-a489-4764431b7b11" (UID: "018eed55-684d-4282-a489-4764431b7b11"). InnerVolumeSpecName "kube-api-access-75f9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:43:16.519990 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.519968    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018eed55-684d-4282-a489-4764431b7b11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "018eed55-684d-4282-a489-4764431b7b11" (UID: "018eed55-684d-4282-a489-4764431b7b11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:43:16.520067 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.520043    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-dshm" (OuterVolumeSpecName: "dshm") pod "018eed55-684d-4282-a489-4764431b7b11" (UID: "018eed55-684d-4282-a489-4764431b7b11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:43:16.619194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.619169    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75f9q\" (UniqueName: \"kubernetes.io/projected/018eed55-684d-4282-a489-4764431b7b11-kube-api-access-75f9q\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:43:16.619194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.619191    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:43:16.619316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.619202    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018eed55-684d-4282-a489-4764431b7b11-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:43:16.619316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:16.619212    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018eed55-684d-4282-a489-4764431b7b11-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:43:17.376566 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:17.376541    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"
Sep 06 12:43:17.377006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:17.376565    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx" event={"ID":"018eed55-684d-4282-a489-4764431b7b11","Type":"ContainerDied","Data":"80e61bc92c32158ee503b8c5fb8762f04504290ae5008a741e771259f6fdb348"}
Sep 06 12:43:17.377006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:17.376649    2568 scope.go:117] "RemoveContainer" containerID="0a759400fd01e72c2ee0a51c903a4e9f96e2861e1b7f94cc91cbde9e4e743dcd"
Sep 06 12:43:17.399170 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:17.399148    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"]
Sep 06 12:43:17.403567 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:17.403548    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3feb92/rate-test-model-3feb92-kserve-bbf779667-jqbkx"]
Sep 06 12:43:18.514234 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:18.514206    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018eed55-684d-4282-a489-4764431b7b11" path="/var/lib/kubelet/pods/018eed55-684d-4282-a489-4764431b7b11/volumes"
Sep 06 12:43:20.279892 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:20.279840    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:28.632146 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:28.632110    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:28.692731 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:28.692700    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:30.702047 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:30.702000    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:31.370489 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:31.370457    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:31.693184 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:31.693152    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:32.147369 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:32.147263    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:34.917930 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:34.917897    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:35.016454 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:35.016421    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:36.087006 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.086962    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:36.189288 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.189255    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:36.426541 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.426460    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:36.885403 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.885367    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:36.987827 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.987797    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"]
Sep 06 12:43:36.988136 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988124    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy"
Sep 06 12:43:36.988207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988138    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy"
Sep 06 12:43:36.988207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988147    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy"
Sep 06 12:43:36.988207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988152    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy"
Sep 06 12:43:36.988207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988160    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1ed3c2-55a8-4225-bdbc-3a9b31d06219" containerName="revoke-keys"
Sep 06 12:43:36.988207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988166    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1ed3c2-55a8-4225-bdbc-3a9b31d06219" containerName="revoke-keys"
Sep 06 12:43:36.988207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988181    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018eed55-684d-4282-a489-4764431b7b11" containerName="main"
Sep 06 12:43:36.988207 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988185    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="018eed55-684d-4282-a489-4764431b7b11" containerName="main"
Sep 06 12:43:36.988471 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988237    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy"
Sep 06 12:43:36.988471 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988245    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="693dc496-927c-427b-a441-739916251ffc" containerName="istio-proxy"
Sep 06 12:43:36.988471 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988253    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="018eed55-684d-4282-a489-4764431b7b11" containerName="main"
Sep 06 12:43:36.988471 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.988261    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1ed3c2-55a8-4225-bdbc-3a9b31d06219" containerName="revoke-keys"
Sep 06 12:43:36.990206 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.990171    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:43:36.992343 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.992324    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:36.994959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:36.994944    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-e2a894\""
Sep 06 12:43:37.004396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.004378    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"]
Sep 06 12:43:37.018237 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.018215    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"]
Sep 06 12:43:37.021405 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.021390    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:37.024348 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.024330    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-e2a894-dockercfg-gv4h6\""
Sep 06 12:43:37.033311 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.033289    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"]
Sep 06 12:43:37.076317 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.076291    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvbx8\" (UniqueName: \"kubernetes.io/projected/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-kube-api-access-nvbx8\") pod \"payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj\" (UID: \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:37.076415 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.076325    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj\" (UID: \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:37.076415 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.076352    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djb82\" (UniqueName: \"kubernetes.io/projected/b3840c99-4583-487c-a379-ad7c58ba6afa-kube-api-access-djb82\") pod \"payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw\" (UID: \"b3840c99-4583-487c-a379-ad7c58ba6afa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:37.076500 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.076416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3840c99-4583-487c-a379-ad7c58ba6afa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw\" (UID: \"b3840c99-4583-487c-a379-ad7c58ba6afa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:37.177725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.177642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvbx8\" (UniqueName: \"kubernetes.io/projected/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-kube-api-access-nvbx8\") pod \"payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj\" (UID: \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:37.177725 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.177692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj\" (UID: \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:37.178143 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.177735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djb82\" (UniqueName: \"kubernetes.io/projected/b3840c99-4583-487c-a379-ad7c58ba6afa-kube-api-access-djb82\") pod \"payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw\" (UID: \"b3840c99-4583-487c-a379-ad7c58ba6afa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:37.178143 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.177784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3840c99-4583-487c-a379-ad7c58ba6afa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw\" (UID: \"b3840c99-4583-487c-a379-ad7c58ba6afa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:37.178655 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.178631    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3840c99-4583-487c-a379-ad7c58ba6afa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw\" (UID: \"b3840c99-4583-487c-a379-ad7c58ba6afa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:37.178701 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.178641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj\" (UID: \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:37.186866 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.186844    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvbx8\" (UniqueName: \"kubernetes.io/projected/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-kube-api-access-nvbx8\") pod \"payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj\" (UID: \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:37.186975 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.186905    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djb82\" (UniqueName: \"kubernetes.io/projected/b3840c99-4583-487c-a379-ad7c58ba6afa-kube-api-access-djb82\") pod \"payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw\" (UID: \"b3840c99-4583-487c-a379-ad7c58ba6afa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:37.302009 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.301983    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:37.334175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.334146    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:37.573809 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.573786    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"]
Sep 06 12:43:37.575882 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:43:37.575855    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3840c99_4583_487c_a379_ad7c58ba6afa.slice/crio-cdc753e40a0e91c3611608769b593cae1d92bb394e780cb9251083dbbb55c9ba WatchSource:0}: Error finding container cdc753e40a0e91c3611608769b593cae1d92bb394e780cb9251083dbbb55c9ba: Status 404 returned error can't find the container with id cdc753e40a0e91c3611608769b593cae1d92bb394e780cb9251083dbbb55c9ba
Sep 06 12:43:37.617491 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:37.617464    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"]
Sep 06 12:43:37.619037 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:43:37.619016    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ada5043_74b0_498f_83cb_0a0ac46f6cdd.slice/crio-21ebdda7de18bfa282a40c5b3eec8c48d3724be6e10c4f5350c71692f11ff759 WatchSource:0}: Error finding container 21ebdda7de18bfa282a40c5b3eec8c48d3724be6e10c4f5350c71692f11ff759: Status 404 returned error can't find the container with id 21ebdda7de18bfa282a40c5b3eec8c48d3724be6e10c4f5350c71692f11ff759
Sep 06 12:43:38.485460 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:38.485420    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw" event={"ID":"b3840c99-4583-487c-a379-ad7c58ba6afa","Type":"ContainerStarted","Data":"6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f"}
Sep 06 12:43:38.485944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:38.485484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw" event={"ID":"b3840c99-4583-487c-a379-ad7c58ba6afa","Type":"ContainerStarted","Data":"cdc753e40a0e91c3611608769b593cae1d92bb394e780cb9251083dbbb55c9ba"}
Sep 06 12:43:38.485944 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:38.485515    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:38.487058 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:38.487036    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj" event={"ID":"6ada5043-74b0-498f-83cb-0a0ac46f6cdd","Type":"ContainerStarted","Data":"693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415"}
Sep 06 12:43:38.487172 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:38.487081    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj" event={"ID":"6ada5043-74b0-498f-83cb-0a0ac46f6cdd","Type":"ContainerStarted","Data":"21ebdda7de18bfa282a40c5b3eec8c48d3724be6e10c4f5350c71692f11ff759"}
Sep 06 12:43:38.487172 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:38.487118    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:38.503475 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:38.503426    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw" podStartSLOduration=2.503406062 podStartE2EDuration="2.503406062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:43:38.502929928 +0000 UTC m=+1558.476977120" watchObservedRunningTime="2026-09-06 12:43:38.503406062 +0000 UTC m=+1558.477453250"
Sep 06 12:43:38.519953 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:38.519913    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj" podStartSLOduration=2.519898409 podStartE2EDuration="2.519898409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:43:38.518449128 +0000 UTC m=+1558.492496311" watchObservedRunningTime="2026-09-06 12:43:38.519898409 +0000 UTC m=+1558.493945594"
Sep 06 12:43:49.494998 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:49.494971    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:43:49.495426 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:49.495037    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:43:59.851215 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:43:59.851179    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:44:04.903279 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:04.903248    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj_6ada5043-74b0-498f-83cb-0a0ac46f6cdd/payload-processing/0.log"
Sep 06 12:44:27.410046 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.410013    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"]
Sep 06 12:44:27.413665 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.413642    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.416259 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.416240    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-4f1951\"/\"default-dockercfg-hzngv\""
Sep 06 12:44:27.416864 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.416843    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-4f1951\"/\"ipp-route-4f1951-kserve-self-signed-certs\""
Sep 06 12:44:27.416963 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.416883    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-4f1951\"/\"kube-root-ca.crt\""
Sep 06 12:44:27.417029 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.417009    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-4f1951\"/\"openshift-service-ca.crt\""
Sep 06 12:44:27.424211 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.424192    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"]
Sep 06 12:44:27.445505 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.445467    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:44:27.555915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.555889    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-dshm\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.555915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.555917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-model-cache\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.556102 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.555935    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef3bd875-393b-4d85-b5a4-5f926882dafd-tls-certs\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.556102 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.556047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-home\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.556102 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.556094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk9p6\" (UniqueName: \"kubernetes.io/projected/ef3bd875-393b-4d85-b5a4-5f926882dafd-kube-api-access-vk9p6\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.556202 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.556124    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-tmp-dir\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.656731 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.656705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-dshm\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.656731 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.656736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-model-cache\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.656915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.656752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef3bd875-393b-4d85-b5a4-5f926882dafd-tls-certs\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.656915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.656791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-home\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.656915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.656836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk9p6\" (UniqueName: \"kubernetes.io/projected/ef3bd875-393b-4d85-b5a4-5f926882dafd-kube-api-access-vk9p6\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.656915 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.656885    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-tmp-dir\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.657151 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.657126    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-model-cache\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.657230 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.657193    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-home\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.657359 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.657276    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-tmp-dir\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.659126 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.659102    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-dshm\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.659339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.659324    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef3bd875-393b-4d85-b5a4-5f926882dafd-tls-certs\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.664753 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.664706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk9p6\" (UniqueName: \"kubernetes.io/projected/ef3bd875-393b-4d85-b5a4-5f926882dafd-kube-api-access-vk9p6\") pod \"ipp-route-4f1951-kserve-6dd859b7c5-ljn9s\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") " pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.723249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.723232    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:27.992555 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:27.992532    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"]
Sep 06 12:44:27.994518 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:44:27.994484    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef3bd875_393b_4d85_b5a4_5f926882dafd.slice/crio-c53d0837e1d1420659c57e8201eeee607614b8c4ca8577c7ba7d2d5639c29656 WatchSource:0}: Error finding container c53d0837e1d1420659c57e8201eeee607614b8c4ca8577c7ba7d2d5639c29656: Status 404 returned error can't find the container with id c53d0837e1d1420659c57e8201eeee607614b8c4ca8577c7ba7d2d5639c29656
Sep 06 12:44:28.719742 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:28.719702    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s" event={"ID":"ef3bd875-393b-4d85-b5a4-5f926882dafd","Type":"ContainerStarted","Data":"3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5"}
Sep 06 12:44:28.720100 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:28.719752    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s" event={"ID":"ef3bd875-393b-4d85-b5a4-5f926882dafd","Type":"ContainerStarted","Data":"c53d0837e1d1420659c57e8201eeee607614b8c4ca8577c7ba7d2d5639c29656"}
Sep 06 12:44:28.735814 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:28.735773    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s" podStartSLOduration=1.7357583490000001 podStartE2EDuration="1.735758349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:44:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:44:28.734447296 +0000 UTC m=+1608.708494482" watchObservedRunningTime="2026-09-06 12:44:28.735758349 +0000 UTC m=+1608.709805549"
Sep 06 12:44:37.723544 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:37.723462    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:37.723544 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:37.723508    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:37.735785 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:37.735763    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:37.771472 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:37.771451    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:44:40.720949 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:40.720921    2568 scope.go:117] "RemoveContainer" containerID="8bad87b1499b41dbc8b4220cfc68d50ff8b8209df50df41fe32a2e756c360e4a"
Sep 06 12:44:55.970993 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:55.970962    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj_6ada5043-74b0-498f-83cb-0a0ac46f6cdd/payload-processing/0.log"
Sep 06 12:44:56.224923 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:56.224829    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:44:56.530255 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:56.530158    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:44:56.884935 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:56.884849    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:44:59.415358 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:59.415321    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:44:59.503926 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:44:59.503900    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:00.133873 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.133842    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"]
Sep 06 12:45:00.138700 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.138678    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"]
Sep 06 12:45:00.138832 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.138778    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"
Sep 06 12:45:00.140816 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.140798    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:45:00.142213 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.142197    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"]
Sep 06 12:45:00.142316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.142308    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"
Sep 06 12:45:00.145478 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.145461    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"]
Sep 06 12:45:00.145627 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.145535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"
Sep 06 12:45:00.152005 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.151981    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"]
Sep 06 12:45:00.152121 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.152023    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"
Sep 06 12:45:00.154804 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.154783    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"]
Sep 06 12:45:00.162885 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.162866    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"
Sep 06 12:45:00.197713 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.197684    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"
Sep 06 12:45:00.440115 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.440091    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"]
Sep 06 12:45:00.442779 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:45:00.442754    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34839f9a_cefb_4222_b8bf_b5b76418c128.slice/crio-599f8cf9c634f5ed4a6a4297f655e3e022e9f63b6894e3f51db94b8d58e9d4fa WatchSource:0}: Error finding container 599f8cf9c634f5ed4a6a4297f655e3e022e9f63b6894e3f51db94b8d58e9d4fa: Status 404 returned error can't find the container with id 599f8cf9c634f5ed4a6a4297f655e3e022e9f63b6894e3f51db94b8d58e9d4fa
Sep 06 12:45:00.462558 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.462325    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"]
Sep 06 12:45:00.483111 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.483093    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"]
Sep 06 12:45:00.484410 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:45:00.484388    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735894db_3d97_46a2_861a_fa7bbefab469.slice/crio-8dc5cdae3bf2cd6fc4c77235cc77feead7250018e0e9635fd94cd00c8753742d WatchSource:0}: Error finding container 8dc5cdae3bf2cd6fc4c77235cc77feead7250018e0e9635fd94cd00c8753742d: Status 404 returned error can't find the container with id 8dc5cdae3bf2cd6fc4c77235cc77feead7250018e0e9635fd94cd00c8753742d
Sep 06 12:45:00.598703 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.598672    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:00.698632 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.698533    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:00.874828 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.874798    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7" event={"ID":"44c3d36f-0c4d-4453-a440-28a874e78782","Type":"ContainerStarted","Data":"d5b7a1d4641e77e4bb8ba064bc2c6c1eddedc37717489609c5e1f9b129ec1521"}
Sep 06 12:45:00.874947 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.874858    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7" event={"ID":"44c3d36f-0c4d-4453-a440-28a874e78782","Type":"ContainerStarted","Data":"f1d55a611e2eade287735a3e33b543e34f61b6b12f8544b0ea0dc5c0cfb487e3"}
Sep 06 12:45:00.876282 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.876257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4" event={"ID":"735894db-3d97-46a2-861a-fa7bbefab469","Type":"ContainerStarted","Data":"5aff582a518fca1c33e92f9b91f77558b1da11d4d1a535c9d1a9343d807ab52e"}
Sep 06 12:45:00.876383 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.876301    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4" event={"ID":"735894db-3d97-46a2-861a-fa7bbefab469","Type":"ContainerStarted","Data":"8dc5cdae3bf2cd6fc4c77235cc77feead7250018e0e9635fd94cd00c8753742d"}
Sep 06 12:45:00.877801 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.877781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c" event={"ID":"34839f9a-cefb-4222-b8bf-b5b76418c128","Type":"ContainerStarted","Data":"0454b912c9119f0615e9abb3b035923f84771812861ffc3ec5919208ec474494"}
Sep 06 12:45:00.877893 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.877818    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c" event={"ID":"34839f9a-cefb-4222-b8bf-b5b76418c128","Type":"ContainerStarted","Data":"599f8cf9c634f5ed4a6a4297f655e3e022e9f63b6894e3f51db94b8d58e9d4fa"}
Sep 06 12:45:00.896737 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.896696    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7" podStartSLOduration=0.896682452 podStartE2EDuration="896.682452ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:45:00.894851996 +0000 UTC m=+1640.868899181" watchObservedRunningTime="2026-09-06 12:45:00.896682452 +0000 UTC m=+1640.870729637"
Sep 06 12:45:00.899251 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.899230    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:00.908472 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.908430    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4" podStartSLOduration=0.908416986 podStartE2EDuration="908.416986ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:45:00.907487221 +0000 UTC m=+1640.881534410" watchObservedRunningTime="2026-09-06 12:45:00.908416986 +0000 UTC m=+1640.882464165"
Sep 06 12:45:00.920845 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:00.920809    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c" podStartSLOduration=0.92079688 podStartE2EDuration="920.79688ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:45:00.919399034 +0000 UTC m=+1640.893446218" watchObservedRunningTime="2026-09-06 12:45:00.92079688 +0000 UTC m=+1640.894844066"
Sep 06 12:45:01.152732 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:01.152656    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:01.259235 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:01.259197    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:01.885175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:01.885102    2568 generic.go:356] "Generic (PLEG): container finished" podID="44c3d36f-0c4d-4453-a440-28a874e78782" containerID="d5b7a1d4641e77e4bb8ba064bc2c6c1eddedc37717489609c5e1f9b129ec1521" exitCode=0
Sep 06 12:45:01.885570 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:01.885191    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7" event={"ID":"44c3d36f-0c4d-4453-a440-28a874e78782","Type":"ContainerDied","Data":"d5b7a1d4641e77e4bb8ba064bc2c6c1eddedc37717489609c5e1f9b129ec1521"}
Sep 06 12:45:01.886721 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:01.886694    2568 generic.go:356] "Generic (PLEG): container finished" podID="735894db-3d97-46a2-861a-fa7bbefab469" containerID="5aff582a518fca1c33e92f9b91f77558b1da11d4d1a535c9d1a9343d807ab52e" exitCode=0
Sep 06 12:45:01.886841 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:01.886777    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4" event={"ID":"735894db-3d97-46a2-861a-fa7bbefab469","Type":"ContainerDied","Data":"5aff582a518fca1c33e92f9b91f77558b1da11d4d1a535c9d1a9343d807ab52e"}
Sep 06 12:45:01.888330 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:01.888310    2568 generic.go:356] "Generic (PLEG): container finished" podID="34839f9a-cefb-4222-b8bf-b5b76418c128" containerID="0454b912c9119f0615e9abb3b035923f84771812861ffc3ec5919208ec474494" exitCode=0
Sep 06 12:45:01.888430 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:01.888343    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c" event={"ID":"34839f9a-cefb-4222-b8bf-b5b76418c128","Type":"ContainerDied","Data":"0454b912c9119f0615e9abb3b035923f84771812861ffc3ec5919208ec474494"}
Sep 06 12:45:03.069530 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.069505    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"
Sep 06 12:45:03.072423 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.072403    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"
Sep 06 12:45:03.075503 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.075484    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"
Sep 06 12:45:03.901212 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.901187    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"
Sep 06 12:45:03.901396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.901234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c" event={"ID":"34839f9a-cefb-4222-b8bf-b5b76418c128","Type":"ContainerDied","Data":"599f8cf9c634f5ed4a6a4297f655e3e022e9f63b6894e3f51db94b8d58e9d4fa"}
Sep 06 12:45:03.901396 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.901286    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="599f8cf9c634f5ed4a6a4297f655e3e022e9f63b6894e3f51db94b8d58e9d4fa"
Sep 06 12:45:03.902741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.902715    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"
Sep 06 12:45:03.902741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.902736    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7" event={"ID":"44c3d36f-0c4d-4453-a440-28a874e78782","Type":"ContainerDied","Data":"f1d55a611e2eade287735a3e33b543e34f61b6b12f8544b0ea0dc5c0cfb487e3"}
Sep 06 12:45:03.902922 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.902770    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1d55a611e2eade287735a3e33b543e34f61b6b12f8544b0ea0dc5c0cfb487e3"
Sep 06 12:45:03.904175 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.904152    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4" event={"ID":"735894db-3d97-46a2-861a-fa7bbefab469","Type":"ContainerDied","Data":"8dc5cdae3bf2cd6fc4c77235cc77feead7250018e0e9635fd94cd00c8753742d"}
Sep 06 12:45:03.904266 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.904197    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dc5cdae3bf2cd6fc4c77235cc77feead7250018e0e9635fd94cd00c8753742d"
Sep 06 12:45:03.904266 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:03.904235    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"
Sep 06 12:45:24.384990 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:24.384955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:25.028708 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.028673    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"]
Sep 06 12:45:25.029194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029177    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44c3d36f-0c4d-4453-a440-28a874e78782" containerName="cleanup"
Sep 06 12:45:25.029246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029197    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="44c3d36f-0c4d-4453-a440-28a874e78782" containerName="cleanup"
Sep 06 12:45:25.029246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029206    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735894db-3d97-46a2-861a-fa7bbefab469" containerName="cleanup"
Sep 06 12:45:25.029246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029211    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="735894db-3d97-46a2-861a-fa7bbefab469" containerName="cleanup"
Sep 06 12:45:25.029246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029217    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34839f9a-cefb-4222-b8bf-b5b76418c128" containerName="cleanup"
Sep 06 12:45:25.029246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029223    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="34839f9a-cefb-4222-b8bf-b5b76418c128" containerName="cleanup"
Sep 06 12:45:25.029408 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029294    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="44c3d36f-0c4d-4453-a440-28a874e78782" containerName="cleanup"
Sep 06 12:45:25.029408 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029303    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="34839f9a-cefb-4222-b8bf-b5b76418c128" containerName="cleanup"
Sep 06 12:45:25.029408 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.029310    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="735894db-3d97-46a2-861a-fa7bbefab469" containerName="cleanup"
Sep 06 12:45:25.032172 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.032157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"
Sep 06 12:45:25.034060 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.034031    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:45:25.034185 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.034120    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:45:25.038237 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.038202    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"]
Sep 06 12:45:25.121774 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.121752    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d428bf0-97ff-4758-aab2-eeefd65d7c64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd\" (UID: \"0d428bf0-97ff-4758-aab2-eeefd65d7c64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"
Sep 06 12:45:25.223000 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.222981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d428bf0-97ff-4758-aab2-eeefd65d7c64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd\" (UID: \"0d428bf0-97ff-4758-aab2-eeefd65d7c64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"
Sep 06 12:45:25.223512 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.223495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d428bf0-97ff-4758-aab2-eeefd65d7c64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd\" (UID: \"0d428bf0-97ff-4758-aab2-eeefd65d7c64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"
Sep 06 12:45:25.344091 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.344043    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"
Sep 06 12:45:25.613089 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:25.613067    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"]
Sep 06 12:45:25.615021 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:45:25.614988    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d428bf0_97ff_4758_aab2_eeefd65d7c64.slice/crio-bdc80d87e10d6d9236688dcf05d3c4853d1ca57740ca378571f6866f5c8d52ef WatchSource:0}: Error finding container bdc80d87e10d6d9236688dcf05d3c4853d1ca57740ca378571f6866f5c8d52ef: Status 404 returned error can't find the container with id bdc80d87e10d6d9236688dcf05d3c4853d1ca57740ca378571f6866f5c8d52ef
Sep 06 12:45:26.018109 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:26.018073    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd" event={"ID":"0d428bf0-97ff-4758-aab2-eeefd65d7c64","Type":"ContainerStarted","Data":"af507722f0c28a6da3fa97fda8824b7b1d3b611e2f7bf4d5c771655677a1ef1b"}
Sep 06 12:45:26.018228 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:26.018130    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd" event={"ID":"0d428bf0-97ff-4758-aab2-eeefd65d7c64","Type":"ContainerStarted","Data":"bdc80d87e10d6d9236688dcf05d3c4853d1ca57740ca378571f6866f5c8d52ef"}
Sep 06 12:45:26.033316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:26.033273    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd" podStartSLOduration=1.033258726 podStartE2EDuration="1.033258726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:45:26.03169133 +0000 UTC m=+1666.005738515" watchObservedRunningTime="2026-09-06 12:45:26.033258726 +0000 UTC m=+1666.007305911"
Sep 06 12:45:27.024299 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:27.024267    2568 generic.go:356] "Generic (PLEG): container finished" podID="0d428bf0-97ff-4758-aab2-eeefd65d7c64" containerID="af507722f0c28a6da3fa97fda8824b7b1d3b611e2f7bf4d5c771655677a1ef1b" exitCode=0
Sep 06 12:45:27.024661 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:27.024346    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd" event={"ID":"0d428bf0-97ff-4758-aab2-eeefd65d7c64","Type":"ContainerDied","Data":"af507722f0c28a6da3fa97fda8824b7b1d3b611e2f7bf4d5c771655677a1ef1b"}
Sep 06 12:45:28.154261 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:28.154240    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"
Sep 06 12:45:28.244062 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:28.244038    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d428bf0-97ff-4758-aab2-eeefd65d7c64-maas-api-service-ca\") pod \"0d428bf0-97ff-4758-aab2-eeefd65d7c64\" (UID: \"0d428bf0-97ff-4758-aab2-eeefd65d7c64\") "
Sep 06 12:45:28.244385 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:28.244365    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d428bf0-97ff-4758-aab2-eeefd65d7c64-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d428bf0-97ff-4758-aab2-eeefd65d7c64" (UID: "0d428bf0-97ff-4758-aab2-eeefd65d7c64"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:45:28.345271 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:28.345221    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d428bf0-97ff-4758-aab2-eeefd65d7c64-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:45:29.035035 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:29.034998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd" event={"ID":"0d428bf0-97ff-4758-aab2-eeefd65d7c64","Type":"ContainerDied","Data":"bdc80d87e10d6d9236688dcf05d3c4853d1ca57740ca378571f6866f5c8d52ef"}
Sep 06 12:45:29.035035 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:29.035013    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"
Sep 06 12:45:29.035035 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:29.035041    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdc80d87e10d6d9236688dcf05d3c4853d1ca57740ca378571f6866f5c8d52ef"
Sep 06 12:45:31.070979 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:31.070941    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:31.137760 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:31.137730    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:31.234251 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:31.234221    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:31.258786 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:31.258751    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"]
Sep 06 12:45:31.261947 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:31.261927    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c82458-vhsgd"]
Sep 06 12:45:31.288798 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:31.288773    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:31.603952 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:31.603919    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:32.514534 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:32.514506    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d428bf0-97ff-4758-aab2-eeefd65d7c64" path="/var/lib/kubelet/pods/0d428bf0-97ff-4758-aab2-eeefd65d7c64/volumes"
Sep 06 12:45:37.179272 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:37.179236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:37.280233 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:37.280205    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:37.434970 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:37.434897    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:40.833821 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.833788    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"]
Sep 06 12:45:40.834193 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.834125    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d428bf0-97ff-4758-aab2-eeefd65d7c64" containerName="revoke-keys"
Sep 06 12:45:40.834193 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.834137    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d428bf0-97ff-4758-aab2-eeefd65d7c64" containerName="revoke-keys"
Sep 06 12:45:40.834279 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.834205    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d428bf0-97ff-4758-aab2-eeefd65d7c64" containerName="revoke-keys"
Sep 06 12:45:40.837156 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.837142    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"
Sep 06 12:45:40.839139 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.839117    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:45:40.839252 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.839179    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:45:40.843498 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.843479    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"]
Sep 06 12:45:40.943043 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.943020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1ac3e-9297-4bc7-beb8-f79da90193fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm\" (UID: \"77e1ac3e-9297-4bc7-beb8-f79da90193fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"
Sep 06 12:45:40.979550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:40.979509    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:41.043991 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:41.043968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1ac3e-9297-4bc7-beb8-f79da90193fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm\" (UID: \"77e1ac3e-9297-4bc7-beb8-f79da90193fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"
Sep 06 12:45:41.044535 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:41.044517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1ac3e-9297-4bc7-beb8-f79da90193fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm\" (UID: \"77e1ac3e-9297-4bc7-beb8-f79da90193fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"
Sep 06 12:45:41.148495 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:41.148431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"
Sep 06 12:45:41.416698 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:41.416667    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"]
Sep 06 12:45:41.419208 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:45:41.419175    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e1ac3e_9297_4bc7_beb8_f79da90193fc.slice/crio-570668ed101e18790a6ffb97ac494854a2329f2cf639518d2141fb05a3beec8d WatchSource:0}: Error finding container 570668ed101e18790a6ffb97ac494854a2329f2cf639518d2141fb05a3beec8d: Status 404 returned error can't find the container with id 570668ed101e18790a6ffb97ac494854a2329f2cf639518d2141fb05a3beec8d
Sep 06 12:45:42.109078 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:42.109051    2568 generic.go:356] "Generic (PLEG): container finished" podID="77e1ac3e-9297-4bc7-beb8-f79da90193fc" containerID="68dedb59100ed45fc213461673d6d9d007f24f90c8cfdbfbb2eceda10f3e8891" exitCode=0
Sep 06 12:45:42.109375 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:42.109113    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm" event={"ID":"77e1ac3e-9297-4bc7-beb8-f79da90193fc","Type":"ContainerDied","Data":"68dedb59100ed45fc213461673d6d9d007f24f90c8cfdbfbb2eceda10f3e8891"}
Sep 06 12:45:42.109375 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:42.109161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm" event={"ID":"77e1ac3e-9297-4bc7-beb8-f79da90193fc","Type":"ContainerStarted","Data":"570668ed101e18790a6ffb97ac494854a2329f2cf639518d2141fb05a3beec8d"}
Sep 06 12:45:43.236714 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:43.236692    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"
Sep 06 12:45:43.363204 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:43.363178    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1ac3e-9297-4bc7-beb8-f79da90193fc-maas-api-service-ca\") pod \"77e1ac3e-9297-4bc7-beb8-f79da90193fc\" (UID: \"77e1ac3e-9297-4bc7-beb8-f79da90193fc\") "
Sep 06 12:45:43.363529 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:43.363506    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77e1ac3e-9297-4bc7-beb8-f79da90193fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77e1ac3e-9297-4bc7-beb8-f79da90193fc" (UID: "77e1ac3e-9297-4bc7-beb8-f79da90193fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:45:43.464376 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:43.464348    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1ac3e-9297-4bc7-beb8-f79da90193fc-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:45:44.120262 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:44.120220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm" event={"ID":"77e1ac3e-9297-4bc7-beb8-f79da90193fc","Type":"ContainerDied","Data":"570668ed101e18790a6ffb97ac494854a2329f2cf639518d2141fb05a3beec8d"}
Sep 06 12:45:44.120262 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:44.120246    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"
Sep 06 12:45:44.120459 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:44.120308    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="570668ed101e18790a6ffb97ac494854a2329f2cf639518d2141fb05a3beec8d"
Sep 06 12:45:56.387833 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.387802    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"]
Sep 06 12:45:56.389064 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.389028    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:56.392099 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.392066    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-4f1951-29811645-jdhk4"]
Sep 06 12:45:56.457440 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.457408    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:56.515208 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.515181    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="735894db-3d97-46a2-861a-fa7bbefab469" path="/var/lib/kubelet/pods/735894db-3d97-46a2-861a-fa7bbefab469/volumes"
Sep 06 12:45:56.516516 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.516481    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:56.568507 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.568485    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"]
Sep 06 12:45:56.575221 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.575199    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4f1951-bkgxm"]
Sep 06 12:45:56.577038 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.577013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:56.641098 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.641036    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:56.941189 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:56.941148    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:45:58.514394 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:45:58.514360    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e1ac3e-9297-4bc7-beb8-f79da90193fc" path="/var/lib/kubelet/pods/77e1ac3e-9297-4bc7-beb8-f79da90193fc/volumes"
Sep 06 12:46:01.924870 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:01.924790    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"]
Sep 06 12:46:02.024928 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:02.024887    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:16.618361 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:16.618321    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:16.944558 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:16.944501    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s" podUID="ef3bd875-393b-4d85-b5a4-5f926882dafd" containerName="main" containerID="cri-o://3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5" gracePeriod=45
Sep 06 12:46:17.183866 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.183844    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:46:17.289488 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.289414    2568 generic.go:356] "Generic (PLEG): container finished" podID="ef3bd875-393b-4d85-b5a4-5f926882dafd" containerID="3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5" exitCode=0
Sep 06 12:46:17.289488 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.289459    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"
Sep 06 12:46:17.289705 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.289499    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s" event={"ID":"ef3bd875-393b-4d85-b5a4-5f926882dafd","Type":"ContainerDied","Data":"3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5"}
Sep 06 12:46:17.289705 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.289535    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s" event={"ID":"ef3bd875-393b-4d85-b5a4-5f926882dafd","Type":"ContainerDied","Data":"c53d0837e1d1420659c57e8201eeee607614b8c4ca8577c7ba7d2d5639c29656"}
Sep 06 12:46:17.289705 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.289553    2568 scope.go:117] "RemoveContainer" containerID="3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5"
Sep 06 12:46:17.297582 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.297564    2568 scope.go:117] "RemoveContainer" containerID="3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5"
Sep 06 12:46:17.297870 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:46:17.297852    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5\": container with ID starting with 3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5 not found: ID does not exist" containerID="3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5"
Sep 06 12:46:17.297937 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.297878    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5"} err="failed to get container status \"3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5\": rpc error: code = NotFound desc = could not find container \"3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5\": container with ID starting with 3f0698970261675cc0ff20dc142ba0564183c04f3744d100f51c07259537eee5 not found: ID does not exist"
Sep 06 12:46:17.320716 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.320698    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-tmp-dir\") pod \"ef3bd875-393b-4d85-b5a4-5f926882dafd\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") "
Sep 06 12:46:17.320801 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.320728    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef3bd875-393b-4d85-b5a4-5f926882dafd-tls-certs\") pod \"ef3bd875-393b-4d85-b5a4-5f926882dafd\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") "
Sep 06 12:46:17.320801 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.320748    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-home\") pod \"ef3bd875-393b-4d85-b5a4-5f926882dafd\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") "
Sep 06 12:46:17.320801 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.320777    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-model-cache\") pod \"ef3bd875-393b-4d85-b5a4-5f926882dafd\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") "
Sep 06 12:46:17.320924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.320820    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-dshm\") pod \"ef3bd875-393b-4d85-b5a4-5f926882dafd\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") "
Sep 06 12:46:17.320924 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.320870    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk9p6\" (UniqueName: \"kubernetes.io/projected/ef3bd875-393b-4d85-b5a4-5f926882dafd-kube-api-access-vk9p6\") pod \"ef3bd875-393b-4d85-b5a4-5f926882dafd\" (UID: \"ef3bd875-393b-4d85-b5a4-5f926882dafd\") "
Sep 06 12:46:17.321026 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.320952    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef3bd875-393b-4d85-b5a4-5f926882dafd" (UID: "ef3bd875-393b-4d85-b5a4-5f926882dafd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:17.321081 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.321011    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-home" (OuterVolumeSpecName: "home") pod "ef3bd875-393b-4d85-b5a4-5f926882dafd" (UID: "ef3bd875-393b-4d85-b5a4-5f926882dafd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:17.321140 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.321089    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef3bd875-393b-4d85-b5a4-5f926882dafd" (UID: "ef3bd875-393b-4d85-b5a4-5f926882dafd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:17.321198 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.321178    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-tmp-dir\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:17.321198 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.321189    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-home\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:17.321198 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.321197    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-model-cache\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:17.322907 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.322890    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef3bd875-393b-4d85-b5a4-5f926882dafd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef3bd875-393b-4d85-b5a4-5f926882dafd" (UID: "ef3bd875-393b-4d85-b5a4-5f926882dafd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:46:17.323068 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.323048    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef3bd875-393b-4d85-b5a4-5f926882dafd-kube-api-access-vk9p6" (OuterVolumeSpecName: "kube-api-access-vk9p6") pod "ef3bd875-393b-4d85-b5a4-5f926882dafd" (UID: "ef3bd875-393b-4d85-b5a4-5f926882dafd"). InnerVolumeSpecName "kube-api-access-vk9p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:46:17.323132 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.323102    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-dshm" (OuterVolumeSpecName: "dshm") pod "ef3bd875-393b-4d85-b5a4-5f926882dafd" (UID: "ef3bd875-393b-4d85-b5a4-5f926882dafd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:17.421788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.421766    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef3bd875-393b-4d85-b5a4-5f926882dafd-tls-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:17.421788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.421783    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef3bd875-393b-4d85-b5a4-5f926882dafd-dshm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:17.421788 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.421791    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk9p6\" (UniqueName: \"kubernetes.io/projected/ef3bd875-393b-4d85-b5a4-5f926882dafd-kube-api-access-vk9p6\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:17.609223 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.609201    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"]
Sep 06 12:46:17.613772 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:17.613750    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-4f1951/ipp-route-4f1951-kserve-6dd859b7c5-ljn9s"]
Sep 06 12:46:18.514975 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:18.514946    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef3bd875-393b-4d85-b5a4-5f926882dafd" path="/var/lib/kubelet/pods/ef3bd875-393b-4d85-b5a4-5f926882dafd/volumes"
Sep 06 12:46:38.796362 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:38.796330    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:39.003066 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:39.003032    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:44.421020 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:44.420983    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:44.517948 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:44.517921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:44.668356 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:44.668321    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:44.768142 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:44.768056    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:45.049280 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.049210    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"]
Sep 06 12:46:45.049552 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.049539    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e1ac3e-9297-4bc7-beb8-f79da90193fc" containerName="revoke-keys"
Sep 06 12:46:45.049615 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.049554    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e1ac3e-9297-4bc7-beb8-f79da90193fc" containerName="revoke-keys"
Sep 06 12:46:45.049615 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.049566    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef3bd875-393b-4d85-b5a4-5f926882dafd" containerName="main"
Sep 06 12:46:45.049615 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.049571    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef3bd875-393b-4d85-b5a4-5f926882dafd" containerName="main"
Sep 06 12:46:45.049727 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.049644    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="77e1ac3e-9297-4bc7-beb8-f79da90193fc" containerName="revoke-keys"
Sep 06 12:46:45.049727 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.049652    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef3bd875-393b-4d85-b5a4-5f926882dafd" containerName="main"
Sep 06 12:46:45.052346 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.052332    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"
Sep 06 12:46:45.054199 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.054177    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:46:45.054362 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.054217    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:46:45.058769 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.058745    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"]
Sep 06 12:46:45.135666 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.135642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83009a23-601f-4c45-bd61-a9b1035e5703-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb\" (UID: \"83009a23-601f-4c45-bd61-a9b1035e5703\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"
Sep 06 12:46:45.236733 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.236711    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83009a23-601f-4c45-bd61-a9b1035e5703-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb\" (UID: \"83009a23-601f-4c45-bd61-a9b1035e5703\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"
Sep 06 12:46:45.237337 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.237317    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83009a23-601f-4c45-bd61-a9b1035e5703-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb\" (UID: \"83009a23-601f-4c45-bd61-a9b1035e5703\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"
Sep 06 12:46:45.347522 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.347448    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:45.364293 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.364273    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"
Sep 06 12:46:45.636101 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:45.636078    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"]
Sep 06 12:46:45.638393 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:46:45.638361    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83009a23_601f_4c45_bd61_a9b1035e5703.slice/crio-ac8152dc3815270c3f857d8b34d306cc1d2025ac4f099d44a4ed68968e287275 WatchSource:0}: Error finding container ac8152dc3815270c3f857d8b34d306cc1d2025ac4f099d44a4ed68968e287275: Status 404 returned error can't find the container with id ac8152dc3815270c3f857d8b34d306cc1d2025ac4f099d44a4ed68968e287275
Sep 06 12:46:46.260938 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:46.260907    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:46.434034 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:46.434008    2568 generic.go:356] "Generic (PLEG): container finished" podID="83009a23-601f-4c45-bd61-a9b1035e5703" containerID="b0190a315a41bd4eb54240c6b7860c35237b2d77f55764be16e531ba626084ca" exitCode=0
Sep 06 12:46:46.434136 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:46.434075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb" event={"ID":"83009a23-601f-4c45-bd61-a9b1035e5703","Type":"ContainerDied","Data":"b0190a315a41bd4eb54240c6b7860c35237b2d77f55764be16e531ba626084ca"}
Sep 06 12:46:46.434136 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:46.434131    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb" event={"ID":"83009a23-601f-4c45-bd61-a9b1035e5703","Type":"ContainerStarted","Data":"ac8152dc3815270c3f857d8b34d306cc1d2025ac4f099d44a4ed68968e287275"}
Sep 06 12:46:47.579036 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:47.579015    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"
Sep 06 12:46:47.655467 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:47.655442    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83009a23-601f-4c45-bd61-a9b1035e5703-maas-api-service-ca\") pod \"83009a23-601f-4c45-bd61-a9b1035e5703\" (UID: \"83009a23-601f-4c45-bd61-a9b1035e5703\") "
Sep 06 12:46:47.655743 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:47.655724    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83009a23-601f-4c45-bd61-a9b1035e5703-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "83009a23-601f-4c45-bd61-a9b1035e5703" (UID: "83009a23-601f-4c45-bd61-a9b1035e5703"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:46:47.756487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:47.756431    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83009a23-601f-4c45-bd61-a9b1035e5703-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:48.445078 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:48.445051    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"
Sep 06 12:46:48.445078 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:48.445067    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb" event={"ID":"83009a23-601f-4c45-bd61-a9b1035e5703","Type":"ContainerDied","Data":"ac8152dc3815270c3f857d8b34d306cc1d2025ac4f099d44a4ed68968e287275"}
Sep 06 12:46:48.445275 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:48.445114    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac8152dc3815270c3f857d8b34d306cc1d2025ac4f099d44a4ed68968e287275"
Sep 06 12:46:55.532638 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.532587    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"]
Sep 06 12:46:55.536116 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.536090    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e2a894-29811645-fg9s7"]
Sep 06 12:46:55.536685 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.536661    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:55.556978 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.556953    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"]
Sep 06 12:46:55.557242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.557214    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj" podUID="6ada5043-74b0-498f-83cb-0a0ac46f6cdd" containerName="payload-processing" containerID="cri-o://693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415" gracePeriod=30
Sep 06 12:46:55.566511 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.566484    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"]
Sep 06 12:46:55.566783 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.566737    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw" podUID="b3840c99-4583-487c-a379-ad7c58ba6afa" containerName="payload-pre-processing" containerID="cri-o://6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f" gracePeriod=30
Sep 06 12:46:55.635005 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.634980    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:55.725153 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.725119    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"]
Sep 06 12:46:55.728042 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.727999    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:55.729187 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.728668    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e2a894-5twdb"]
Sep 06 12:46:55.795928 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.795844    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:55.831200 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.831180    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:46:55.833840 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.833822    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:46:55.922983 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.922955    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-plugins-config-volume\") pod \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\" (UID: \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\") "
Sep 06 12:46:55.923182 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.923001    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3840c99-4583-487c-a379-ad7c58ba6afa-plugins-config-volume\") pod \"b3840c99-4583-487c-a379-ad7c58ba6afa\" (UID: \"b3840c99-4583-487c-a379-ad7c58ba6afa\") "
Sep 06 12:46:55.923182 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.923035    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djb82\" (UniqueName: \"kubernetes.io/projected/b3840c99-4583-487c-a379-ad7c58ba6afa-kube-api-access-djb82\") pod \"b3840c99-4583-487c-a379-ad7c58ba6afa\" (UID: \"b3840c99-4583-487c-a379-ad7c58ba6afa\") "
Sep 06 12:46:55.923182 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.923148    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvbx8\" (UniqueName: \"kubernetes.io/projected/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-kube-api-access-nvbx8\") pod \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\" (UID: \"6ada5043-74b0-498f-83cb-0a0ac46f6cdd\") "
Sep 06 12:46:55.923393 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.923371    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3840c99-4583-487c-a379-ad7c58ba6afa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3840c99-4583-487c-a379-ad7c58ba6afa" (UID: "b3840c99-4583-487c-a379-ad7c58ba6afa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:46:55.923446 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.923388    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ada5043-74b0-498f-83cb-0a0ac46f6cdd" (UID: "6ada5043-74b0-498f-83cb-0a0ac46f6cdd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:46:55.925223 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.925201    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3840c99-4583-487c-a379-ad7c58ba6afa-kube-api-access-djb82" (OuterVolumeSpecName: "kube-api-access-djb82") pod "b3840c99-4583-487c-a379-ad7c58ba6afa" (UID: "b3840c99-4583-487c-a379-ad7c58ba6afa"). InnerVolumeSpecName "kube-api-access-djb82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:46:55.925344 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:55.925297    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-kube-api-access-nvbx8" (OuterVolumeSpecName: "kube-api-access-nvbx8") pod "6ada5043-74b0-498f-83cb-0a0ac46f6cdd" (UID: "6ada5043-74b0-498f-83cb-0a0ac46f6cdd"). InnerVolumeSpecName "kube-api-access-nvbx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:46:56.024420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.024390    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:56.024420 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.024414    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3840c99-4583-487c-a379-ad7c58ba6afa-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:56.024556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.024427    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djb82\" (UniqueName: \"kubernetes.io/projected/b3840c99-4583-487c-a379-ad7c58ba6afa-kube-api-access-djb82\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:56.024556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.024439    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvbx8\" (UniqueName: \"kubernetes.io/projected/6ada5043-74b0-498f-83cb-0a0ac46f6cdd-kube-api-access-nvbx8\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:46:56.107384 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.107313    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:46:56.486391 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.486367    2568 generic.go:356] "Generic (PLEG): container finished" podID="6ada5043-74b0-498f-83cb-0a0ac46f6cdd" containerID="693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415" exitCode=0
Sep 06 12:46:56.486517 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.486418    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"
Sep 06 12:46:56.486517 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.486449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj" event={"ID":"6ada5043-74b0-498f-83cb-0a0ac46f6cdd","Type":"ContainerDied","Data":"693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415"}
Sep 06 12:46:56.486517 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.486498    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj" event={"ID":"6ada5043-74b0-498f-83cb-0a0ac46f6cdd","Type":"ContainerDied","Data":"21ebdda7de18bfa282a40c5b3eec8c48d3724be6e10c4f5350c71692f11ff759"}
Sep 06 12:46:56.486723 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.486525    2568 scope.go:117] "RemoveContainer" containerID="693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415"
Sep 06 12:46:56.487906 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.487888    2568 generic.go:356] "Generic (PLEG): container finished" podID="b3840c99-4583-487c-a379-ad7c58ba6afa" containerID="6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f" exitCode=0
Sep 06 12:46:56.487994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.487919    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw" event={"ID":"b3840c99-4583-487c-a379-ad7c58ba6afa","Type":"ContainerDied","Data":"6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f"}
Sep 06 12:46:56.487994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.487956    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw" event={"ID":"b3840c99-4583-487c-a379-ad7c58ba6afa","Type":"ContainerDied","Data":"cdc753e40a0e91c3611608769b593cae1d92bb394e780cb9251083dbbb55c9ba"}
Sep 06 12:46:56.488114 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.488089    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"
Sep 06 12:46:56.496533 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.496520    2568 scope.go:117] "RemoveContainer" containerID="693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415"
Sep 06 12:46:56.496838 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:46:56.496821    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415\": container with ID starting with 693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415 not found: ID does not exist" containerID="693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415"
Sep 06 12:46:56.496900 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.496846    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415"} err="failed to get container status \"693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415\": rpc error: code = NotFound desc = could not find container \"693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415\": container with ID starting with 693de889a0027e5e4967bee8c7cf395ec359a6ab41bb0c4a7c9797b4b108b415 not found: ID does not exist"
Sep 06 12:46:56.496900 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.496863    2568 scope.go:117] "RemoveContainer" containerID="6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f"
Sep 06 12:46:56.504431 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.504413    2568 scope.go:117] "RemoveContainer" containerID="6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f"
Sep 06 12:46:56.504729 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:46:56.504712    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f\": container with ID starting with 6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f not found: ID does not exist" containerID="6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f"
Sep 06 12:46:56.504791 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.504735    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f"} err="failed to get container status \"6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f\": rpc error: code = NotFound desc = could not find container \"6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f\": container with ID starting with 6820c74e6ea9b15be42efb231ddf094c17a2cee1265fa6e9204f98714b50359f not found: ID does not exist"
Sep 06 12:46:56.507569 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.507549    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"]
Sep 06 12:46:56.515081 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.515062    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44c3d36f-0c4d-4453-a440-28a874e78782" path="/var/lib/kubelet/pods/44c3d36f-0c4d-4453-a440-28a874e78782/volumes"
Sep 06 12:46:56.515371 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.515357    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83009a23-601f-4c45-bd61-a9b1035e5703" path="/var/lib/kubelet/pods/83009a23-601f-4c45-bd61-a9b1035e5703/volumes"
Sep 06 12:46:56.515629 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.515617    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e2a894-77494b4bfc-g4kdj"]
Sep 06 12:46:56.522472 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.522453    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"]
Sep 06 12:46:56.526231 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:56.526213    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e2a894-6ff59b9b8b-vcjlw"]
Sep 06 12:46:58.514293 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:58.514259    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ada5043-74b0-498f-83cb-0a0ac46f6cdd" path="/var/lib/kubelet/pods/6ada5043-74b0-498f-83cb-0a0ac46f6cdd/volumes"
Sep 06 12:46:58.514656 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:46:58.514591    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3840c99-4583-487c-a379-ad7c58ba6afa" path="/var/lib/kubelet/pods/b3840c99-4583-487c-a379-ad7c58ba6afa/volumes"
Sep 06 12:47:01.805402 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:01.805373    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:01.864671 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:01.864640    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:02.068469 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.068390    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:02.405056 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.404978    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"]
Sep 06 12:47:02.405292 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405280    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3840c99-4583-487c-a379-ad7c58ba6afa" containerName="payload-pre-processing"
Sep 06 12:47:02.405339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405294    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3840c99-4583-487c-a379-ad7c58ba6afa" containerName="payload-pre-processing"
Sep 06 12:47:02.405339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405309    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ada5043-74b0-498f-83cb-0a0ac46f6cdd" containerName="payload-processing"
Sep 06 12:47:02.405339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405315    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ada5043-74b0-498f-83cb-0a0ac46f6cdd" containerName="payload-processing"
Sep 06 12:47:02.405339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405331    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83009a23-601f-4c45-bd61-a9b1035e5703" containerName="revoke-keys"
Sep 06 12:47:02.405339 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405337    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="83009a23-601f-4c45-bd61-a9b1035e5703" containerName="revoke-keys"
Sep 06 12:47:02.405550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405384    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="83009a23-601f-4c45-bd61-a9b1035e5703" containerName="revoke-keys"
Sep 06 12:47:02.405550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405395    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ada5043-74b0-498f-83cb-0a0ac46f6cdd" containerName="payload-processing"
Sep 06 12:47:02.405550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.405401    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3840c99-4583-487c-a379-ad7c58ba6afa" containerName="payload-pre-processing"
Sep 06 12:47:02.409741 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.409724    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"
Sep 06 12:47:02.411702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.411674    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:47:02.411824 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.411710    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:47:02.416196 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.416171    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"]
Sep 06 12:47:02.478133 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.478106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b5605-04e0-4b59-a268-112d0bc05b16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246\" (UID: \"d38b5605-04e0-4b59-a268-112d0bc05b16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"
Sep 06 12:47:02.509875 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.509853    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:02.579166 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.579143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b5605-04e0-4b59-a268-112d0bc05b16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246\" (UID: \"d38b5605-04e0-4b59-a268-112d0bc05b16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"
Sep 06 12:47:02.579720 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.579702    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b5605-04e0-4b59-a268-112d0bc05b16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246\" (UID: \"d38b5605-04e0-4b59-a268-112d0bc05b16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"
Sep 06 12:47:02.722082 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.722057    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"
Sep 06 12:47:02.995473 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:02.995345    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"]
Sep 06 12:47:02.997713 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:47:02.997683    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38b5605_04e0_4b59_a268_112d0bc05b16.slice/crio-24b69143b27f5d67f81730abc00e1bc00117ab822536aa40b0645ee9bb1c24e4 WatchSource:0}: Error finding container 24b69143b27f5d67f81730abc00e1bc00117ab822536aa40b0645ee9bb1c24e4: Status 404 returned error can't find the container with id 24b69143b27f5d67f81730abc00e1bc00117ab822536aa40b0645ee9bb1c24e4
Sep 06 12:47:03.525411 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:03.525386    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246" event={"ID":"d38b5605-04e0-4b59-a268-112d0bc05b16","Type":"ContainerStarted","Data":"4fe93dbdd7329b6330cce7ea8db67ac4d9b8d9158af26c3df63f1ffee4ed02a8"}
Sep 06 12:47:03.525532 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:03.525435    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246" event={"ID":"d38b5605-04e0-4b59-a268-112d0bc05b16","Type":"ContainerStarted","Data":"24b69143b27f5d67f81730abc00e1bc00117ab822536aa40b0645ee9bb1c24e4"}
Sep 06 12:47:03.538763 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:03.538718    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246" podStartSLOduration=1.538703259 podStartE2EDuration="1.538703259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:47:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:47:03.537555852 +0000 UTC m=+1763.511603037" watchObservedRunningTime="2026-09-06 12:47:03.538703259 +0000 UTC m=+1763.512750444"
Sep 06 12:47:04.532015 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:04.531988    2568 generic.go:356] "Generic (PLEG): container finished" podID="d38b5605-04e0-4b59-a268-112d0bc05b16" containerID="4fe93dbdd7329b6330cce7ea8db67ac4d9b8d9158af26c3df63f1ffee4ed02a8" exitCode=0
Sep 06 12:47:04.532378 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:04.532023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246" event={"ID":"d38b5605-04e0-4b59-a268-112d0bc05b16","Type":"ContainerDied","Data":"4fe93dbdd7329b6330cce7ea8db67ac4d9b8d9158af26c3df63f1ffee4ed02a8"}
Sep 06 12:47:05.660351 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:05.660329    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"
Sep 06 12:47:05.700867 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:05.700845    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b5605-04e0-4b59-a268-112d0bc05b16-maas-api-service-ca\") pod \"d38b5605-04e0-4b59-a268-112d0bc05b16\" (UID: \"d38b5605-04e0-4b59-a268-112d0bc05b16\") "
Sep 06 12:47:05.701194 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:05.701176    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d38b5605-04e0-4b59-a268-112d0bc05b16-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d38b5605-04e0-4b59-a268-112d0bc05b16" (UID: "d38b5605-04e0-4b59-a268-112d0bc05b16"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:47:05.802025 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:05.801973    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b5605-04e0-4b59-a268-112d0bc05b16-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:06.543349 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:06.543327    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"
Sep 06 12:47:06.543475 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:06.543345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246" event={"ID":"d38b5605-04e0-4b59-a268-112d0bc05b16","Type":"ContainerDied","Data":"24b69143b27f5d67f81730abc00e1bc00117ab822536aa40b0645ee9bb1c24e4"}
Sep 06 12:47:06.543475 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:06.543383    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24b69143b27f5d67f81730abc00e1bc00117ab822536aa40b0645ee9bb1c24e4"
Sep 06 12:47:13.058500 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.058467    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:13.065960 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.065932    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"]
Sep 06 12:47:13.068272 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.068248    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3feb92-29811645-7rx2c"]
Sep 06 12:47:13.137083 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.137054    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:13.203487 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.203458    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:13.275531 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.275505    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"]
Sep 06 12:47:13.277849 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.277823    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:13.277957 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.277852    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3feb92-xh246"]
Sep 06 12:47:13.341335 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.341274    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:13.656748 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:13.656664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:14.514189 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:14.514159    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34839f9a-cefb-4222-b8bf-b5b76418c128" path="/var/lib/kubelet/pods/34839f9a-cefb-4222-b8bf-b5b76418c128/volumes"
Sep 06 12:47:14.514537 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:14.514418    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d38b5605-04e0-4b59-a268-112d0bc05b16" path="/var/lib/kubelet/pods/d38b5605-04e0-4b59-a268-112d0bc05b16/volumes"
Sep 06 12:47:15.089496 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:15.089461    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:15.147241 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:15.147214    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:19.558160 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:19.558124    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:19.623583 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:19.623548    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:19.815153 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:19.815071    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"]
Sep 06 12:47:19.815418 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:19.815354    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy" containerID="cri-o://41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5" gracePeriod=30
Sep 06 12:47:19.842833 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:19.842805    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:20.214529 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.214498    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"]
Sep 06 12:47:20.214823 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.214810    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d38b5605-04e0-4b59-a268-112d0bc05b16" containerName="revoke-keys"
Sep 06 12:47:20.214885 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.214824    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d38b5605-04e0-4b59-a268-112d0bc05b16" containerName="revoke-keys"
Sep 06 12:47:20.214921 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.214893    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d38b5605-04e0-4b59-a268-112d0bc05b16" containerName="revoke-keys"
Sep 06 12:47:20.217955 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.217939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"
Sep 06 12:47:20.230446 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.230426    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:47:20.230643 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.230617    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:47:20.240773 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.240749    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"]
Sep 06 12:47:20.320001 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.319979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a99b836-f103-4022-8e23-09906500e7df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt\" (UID: \"8a99b836-f103-4022-8e23-09906500e7df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"
Sep 06 12:47:20.397867 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.397839    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:20.420488 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.420465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a99b836-f103-4022-8e23-09906500e7df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt\" (UID: \"8a99b836-f103-4022-8e23-09906500e7df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"
Sep 06 12:47:20.421041 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.421024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a99b836-f103-4022-8e23-09906500e7df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt\" (UID: \"8a99b836-f103-4022-8e23-09906500e7df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"
Sep 06 12:47:20.527371 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.527295    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"
Sep 06 12:47:20.802184 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:20.802162    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"]
Sep 06 12:47:20.804427 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:47:20.804393    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a99b836_f103_4022_8e23_09906500e7df.slice/crio-dcfa4c03c2577d2451d5c54953d1627ef5c6d1056740a164f64eb8bee9a5282d WatchSource:0}: Error finding container dcfa4c03c2577d2451d5c54953d1627ef5c6d1056740a164f64eb8bee9a5282d: Status 404 returned error can't find the container with id dcfa4c03c2577d2451d5c54953d1627ef5c6d1056740a164f64eb8bee9a5282d
Sep 06 12:47:21.619361 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:21.619332    2568 generic.go:356] "Generic (PLEG): container finished" podID="8a99b836-f103-4022-8e23-09906500e7df" containerID="dd4b252b3d84e2367f4a1323862bdecce37025816db727d59f26231cffbfe6a0" exitCode=0
Sep 06 12:47:21.619486 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:21.619372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt" event={"ID":"8a99b836-f103-4022-8e23-09906500e7df","Type":"ContainerDied","Data":"dd4b252b3d84e2367f4a1323862bdecce37025816db727d59f26231cffbfe6a0"}
Sep 06 12:47:21.619486 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:21.619411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt" event={"ID":"8a99b836-f103-4022-8e23-09906500e7df","Type":"ContainerStarted","Data":"dcfa4c03c2577d2451d5c54953d1627ef5c6d1056740a164f64eb8bee9a5282d"}
Sep 06 12:47:22.755832 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:22.755808    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"
Sep 06 12:47:22.839692 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:22.839667    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a99b836-f103-4022-8e23-09906500e7df-maas-api-service-ca\") pod \"8a99b836-f103-4022-8e23-09906500e7df\" (UID: \"8a99b836-f103-4022-8e23-09906500e7df\") "
Sep 06 12:47:22.839967 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:22.839948    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a99b836-f103-4022-8e23-09906500e7df-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a99b836-f103-4022-8e23-09906500e7df" (UID: "8a99b836-f103-4022-8e23-09906500e7df"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:47:22.940822 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:22.940803    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a99b836-f103-4022-8e23-09906500e7df-maas-api-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:23.636717 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:23.636693    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"
Sep 06 12:47:23.636856 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:23.636715    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt" event={"ID":"8a99b836-f103-4022-8e23-09906500e7df","Type":"ContainerDied","Data":"dcfa4c03c2577d2451d5c54953d1627ef5c6d1056740a164f64eb8bee9a5282d"}
Sep 06 12:47:23.636856 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:23.636754    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcfa4c03c2577d2451d5c54953d1627ef5c6d1056740a164f64eb8bee9a5282d"
Sep 06 12:47:25.058296 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.058271    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:47:25.156055 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.155999    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-credential-socket\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156055 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156036    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29p8s\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-kube-api-access-29p8s\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156063    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-socket\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156099    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-envoy\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156124    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db785ea4-d387-4946-8efe-85b568477c80-istiod-ca-cert\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156142    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db785ea4-d387-4946-8efe-85b568477c80-istio-podinfo\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156168    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-data\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156242 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156201    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-certs\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156250    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-istio-token\") pod \"db785ea4-d387-4946-8efe-85b568477c80\" (UID: \"db785ea4-d387-4946-8efe-85b568477c80\") "
Sep 06 12:47:25.156550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156298    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:25.156550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156424    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:25.156550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156476    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.156550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156512    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-data" (OuterVolumeSpecName: "istio-data") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:25.156550 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156519    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db785ea4-d387-4946-8efe-85b568477c80-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:47:25.157004 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.156593    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:25.158457 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.158431    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:25.158457 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.158442    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-kube-api-access-29p8s" (OuterVolumeSpecName: "kube-api-access-29p8s") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "kube-api-access-29p8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:25.158576 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.158459    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-istio-token" (OuterVolumeSpecName: "istio-token") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:25.158664 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.158643    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db785ea4-d387-4946-8efe-85b568477c80-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "db785ea4-d387-4946-8efe-85b568477c80" (UID: "db785ea4-d387-4946-8efe-85b568477c80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:47:25.257637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.257616    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.257637 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.257637    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29p8s\" (UniqueName: \"kubernetes.io/projected/db785ea4-d387-4946-8efe-85b568477c80-kube-api-access-29p8s\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.257756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.257646    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.257756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.257655    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.257756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.257664    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db785ea4-d387-4946-8efe-85b568477c80-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.257756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.257672    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db785ea4-d387-4946-8efe-85b568477c80-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.257756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.257679    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.257756 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.257686    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db785ea4-d387-4946-8efe-85b568477c80-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:25.647980 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.647959    2568 generic.go:356] "Generic (PLEG): container finished" podID="db785ea4-d387-4946-8efe-85b568477c80" containerID="41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5" exitCode=0
Sep 06 12:47:25.648104 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.648002    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"
Sep 06 12:47:25.648104 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.648053    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" event={"ID":"db785ea4-d387-4946-8efe-85b568477c80","Type":"ContainerDied","Data":"41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5"}
Sep 06 12:47:25.648104 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.648099    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6" event={"ID":"db785ea4-d387-4946-8efe-85b568477c80","Type":"ContainerDied","Data":"fde1becee478c6a1739f0b6ee1035c51bfcc2ab6dce0c11b2752a4e7e4ad03d6"}
Sep 06 12:47:25.648215 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.648121    2568 scope.go:117] "RemoveContainer" containerID="41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5"
Sep 06 12:47:25.657377 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.657363    2568 scope.go:117] "RemoveContainer" containerID="6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631"
Sep 06 12:47:25.665024 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.665004    2568 scope.go:117] "RemoveContainer" containerID="41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5"
Sep 06 12:47:25.665269 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:47:25.665252    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5\": container with ID starting with 41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5 not found: ID does not exist" containerID="41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5"
Sep 06 12:47:25.665316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.665277    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5"} err="failed to get container status \"41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5\": rpc error: code = NotFound desc = could not find container \"41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5\": container with ID starting with 41f1f5dc4501fc84fe6dab309ac0ec3c382ee631d0d40a4c941ef05727dbacc5 not found: ID does not exist"
Sep 06 12:47:25.665316 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.665294    2568 scope.go:117] "RemoveContainer" containerID="6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631"
Sep 06 12:47:25.665526 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:47:25.665507    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631\": container with ID starting with 6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631 not found: ID does not exist" containerID="6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631"
Sep 06 12:47:25.665578 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.665534    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631"} err="failed to get container status \"6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631\": rpc error: code = NotFound desc = could not find container \"6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631\": container with ID starting with 6c2a4fef9cc2fec75fddce42d66a316053d5f9cd97ac644b4ac4264da16b1631 not found: ID does not exist"
Sep 06 12:47:25.668747 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.668724    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"]
Sep 06 12:47:25.672771 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:25.672751    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3feb92-openshift-default-75f7c7d6fd-x7th6"]
Sep 06 12:47:26.514477 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:26.514447    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db785ea4-d387-4946-8efe-85b568477c80" path="/var/lib/kubelet/pods/db785ea4-d387-4946-8efe-85b568477c80/volumes"
Sep 06 12:47:30.721620 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.721565    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:30.749140 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.749110    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"]
Sep 06 12:47:30.749357 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.749333    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9" podUID="1faa4c7d-9a80-4276-ab89-8a965634e196" containerName="payload-pre-processing" containerID="cri-o://1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c" gracePeriod=30
Sep 06 12:47:30.818352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.818323    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:30.910964 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.910935    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"]
Sep 06 12:47:30.912356 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.912322    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:30.912994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.912976    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6515e-5f5kt"]
Sep 06 12:47:30.969724 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.969697    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:30.996991 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:30.996970    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:47:31.100459 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.100432    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r8qn\" (UniqueName: \"kubernetes.io/projected/1faa4c7d-9a80-4276-ab89-8a965634e196-kube-api-access-6r8qn\") pod \"1faa4c7d-9a80-4276-ab89-8a965634e196\" (UID: \"1faa4c7d-9a80-4276-ab89-8a965634e196\") "
Sep 06 12:47:31.100641 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.100516    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1faa4c7d-9a80-4276-ab89-8a965634e196-plugins-config-volume\") pod \"1faa4c7d-9a80-4276-ab89-8a965634e196\" (UID: \"1faa4c7d-9a80-4276-ab89-8a965634e196\") "
Sep 06 12:47:31.100909 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.100886    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1faa4c7d-9a80-4276-ab89-8a965634e196-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1faa4c7d-9a80-4276-ab89-8a965634e196" (UID: "1faa4c7d-9a80-4276-ab89-8a965634e196"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:47:31.102698 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.102674    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1faa4c7d-9a80-4276-ab89-8a965634e196-kube-api-access-6r8qn" (OuterVolumeSpecName: "kube-api-access-6r8qn") pod "1faa4c7d-9a80-4276-ab89-8a965634e196" (UID: "1faa4c7d-9a80-4276-ab89-8a965634e196"). InnerVolumeSpecName "kube-api-access-6r8qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:31.201951 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.201925    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r8qn\" (UniqueName: \"kubernetes.io/projected/1faa4c7d-9a80-4276-ab89-8a965634e196-kube-api-access-6r8qn\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:31.201951 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.201949    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1faa4c7d-9a80-4276-ab89-8a965634e196-plugins-config-volume\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:31.271938 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.271849    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:31.682094 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.681992    2568 generic.go:356] "Generic (PLEG): container finished" podID="1faa4c7d-9a80-4276-ab89-8a965634e196" containerID="1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c" exitCode=0
Sep 06 12:47:31.682094 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.682026    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9" event={"ID":"1faa4c7d-9a80-4276-ab89-8a965634e196","Type":"ContainerDied","Data":"1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c"}
Sep 06 12:47:31.682094 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.682042    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"
Sep 06 12:47:31.682094 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.682084    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9" event={"ID":"1faa4c7d-9a80-4276-ab89-8a965634e196","Type":"ContainerDied","Data":"41a6d44ddeb2c4e8a5ccb4f9d490aafee8e2d2d18628baf767682277240da7d5"}
Sep 06 12:47:31.682324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.682114    2568 scope.go:117] "RemoveContainer" containerID="1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c"
Sep 06 12:47:31.691268 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.691254    2568 scope.go:117] "RemoveContainer" containerID="1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c"
Sep 06 12:47:31.691521 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:47:31.691505    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c\": container with ID starting with 1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c not found: ID does not exist" containerID="1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c"
Sep 06 12:47:31.691576 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.691527    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c"} err="failed to get container status \"1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c\": rpc error: code = NotFound desc = could not find container \"1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c\": container with ID starting with 1bf40151ccbb2598244a366684aaa26123d7320f6fb54ee174e451a37db1681c not found: ID does not exist"
Sep 06 12:47:31.701884 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.701864    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"]
Sep 06 12:47:31.705459 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:31.705440    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6515e-86b859ff74-m6ff9"]
Sep 06 12:47:32.514937 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:32.514905    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1faa4c7d-9a80-4276-ab89-8a965634e196" path="/var/lib/kubelet/pods/1faa4c7d-9a80-4276-ab89-8a965634e196/volumes"
Sep 06 12:47:32.515318 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:32.515198    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a99b836-f103-4022-8e23-09906500e7df" path="/var/lib/kubelet/pods/8a99b836-f103-4022-8e23-09906500e7df/volumes"
Sep 06 12:47:37.181935 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:37.181898    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:37.242994 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:37.242961    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:37.402459 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:37.402427    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"]
Sep 06 12:47:37.402702 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:37.402677    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy" containerID="cri-o://012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480" gracePeriod=30
Sep 06 12:47:37.425009 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:37.424982    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:38.461352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:38.461314    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:47:40.759444 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:40.759415    2568 scope.go:117] "RemoveContainer" containerID="ea5903be0d98534930f83e00c6a9cb9e241a780ae81c2320279cc2ecf36562dc"
Sep 06 12:47:40.767695 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:40.767676    2568 scope.go:117] "RemoveContainer" containerID="eac2c27407010ac3149342b49dde6e4d549f5a9244b67ebf1e271f88d2113b42"
Sep 06 12:47:40.775497 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:40.775476    2568 scope.go:117] "RemoveContainer" containerID="9b641faa456a73ddf9a4b375be8afa8c6de944f51699b5720ae552c3a1dd82f7"
Sep 06 12:47:42.645768 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.645747    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:47:42.737216 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.737190    2568 generic.go:356] "Generic (PLEG): container finished" podID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerID="012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480" exitCode=0
Sep 06 12:47:42.737352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.737242    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"
Sep 06 12:47:42.737352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.737261    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" event={"ID":"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6","Type":"ContainerDied","Data":"012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480"}
Sep 06 12:47:42.737352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.737304    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv" event={"ID":"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6","Type":"ContainerDied","Data":"5427262325d0c30d4b7e02aa130bbabf57a6aa7aa033756728cd9ced269d2ac6"}
Sep 06 12:47:42.737352 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.737325    2568 scope.go:117] "RemoveContainer" containerID="012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480"
Sep 06 12:47:42.745751 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.745729    2568 scope.go:117] "RemoveContainer" containerID="3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983"
Sep 06 12:47:42.753223 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.753208    2568 scope.go:117] "RemoveContainer" containerID="012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480"
Sep 06 12:47:42.753488 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:47:42.753462    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480\": container with ID starting with 012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480 not found: ID does not exist" containerID="012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480"
Sep 06 12:47:42.753542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.753496    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480"} err="failed to get container status \"012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480\": rpc error: code = NotFound desc = could not find container \"012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480\": container with ID starting with 012daa29ff481d2fffb2a8aa72616c4ff3a2b1a70ec0b76ec6a2dbde2584e480 not found: ID does not exist"
Sep 06 12:47:42.753542 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.753513    2568 scope.go:117] "RemoveContainer" containerID="3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983"
Sep 06 12:47:42.753779 ip-10-0-134-80 kubenswrapper[2568]: E0906 12:47:42.753760    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983\": container with ID starting with 3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983 not found: ID does not exist" containerID="3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983"
Sep 06 12:47:42.753839 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.753784    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983"} err="failed to get container status \"3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983\": rpc error: code = NotFound desc = could not find container \"3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983\": container with ID starting with 3d67a4930f3a06ae2d1b0cab8357b1566500999295977bc7a18860708fdee983 not found: ID does not exist"
Sep 06 12:47:42.794078 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794056    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-envoy\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794180 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794084    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istiod-ca-cert\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794180 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794106    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-podinfo\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794180 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794131    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-data\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794336 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794249    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-credential-socket\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794336 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794326    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-token\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794358    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxc57\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-kube-api-access-qxc57\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794373    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:42.794452 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794385    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-certs\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794634 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794501    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:42.794634 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794440    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:47:42.794742 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794630    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:42.794742 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794640    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-socket\") pod \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\" (UID: \"2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6\") "
Sep 06 12:47:42.794855 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.794830    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:42.795135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.795103    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:42.795135 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.795131    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-workload-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:42.795249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.795145    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istiod-ca-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:42.795249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.795159    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-data\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:42.795249 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.795171    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-credential-socket\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:42.796407 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.796385    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:42.796492 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.796403    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:47:42.796556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.796536    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:42.796904 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.796888    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-kube-api-access-qxc57" (OuterVolumeSpecName: "kube-api-access-qxc57") pod "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" (UID: "2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6"). InnerVolumeSpecName "kube-api-access-qxc57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:42.895563 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.895542    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:42.895563 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.895562    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxc57\" (UniqueName: \"kubernetes.io/projected/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-kube-api-access-qxc57\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:42.895699 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.895572    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-envoy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:42.895699 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:42.895580    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6-istio-podinfo\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
Sep 06 12:47:43.058689 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:43.058664    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"]
Sep 06 12:47:43.062694 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:43.062668    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6515e-openshift-default-6658695b44-q2nkv"]
Sep 06 12:47:44.514548 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:47:44.514517    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" path="/var/lib/kubelet/pods/2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6/volumes"
Sep 06 12:48:40.813556 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:48:40.813527    2568 scope.go:117] "RemoveContainer" containerID="cb73f96a0de0c0d4956732727012e80f0197be8c0c744d866120d52ffca00cbb"
Sep 06 12:49:02.802988 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:49:02.802900    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:49:04.376965 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:49:04.376924    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:50:02.175037 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:50:02.175002    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:50:02.232567 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:50:02.232538    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:50:30.405518 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:50:30.405471    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:50:30.505962 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:50:30.505912    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:51:40.847078 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:51:40.847049    2568 scope.go:117] "RemoveContainer" containerID="d5b7a1d4641e77e4bb8ba064bc2c6c1eddedc37717489609c5e1f9b129ec1521"
Sep 06 12:51:40.854830 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:51:40.854810    2568 scope.go:117] "RemoveContainer" containerID="0454b912c9119f0615e9abb3b035923f84771812861ffc3ec5919208ec474494"
Sep 06 12:51:40.861984 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:51:40.861965    2568 scope.go:117] "RemoveContainer" containerID="af507722f0c28a6da3fa97fda8824b7b1d3b611e2f7bf4d5c771655677a1ef1b"
Sep 06 12:51:40.869015 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:51:40.868999    2568 scope.go:117] "RemoveContainer" containerID="5aff582a518fca1c33e92f9b91f77558b1da11d4d1a535c9d1a9343d807ab52e"
Sep 06 12:51:52.796959 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:51:52.796919    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:52:00.039568 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:52:00.039529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:52:35.882356 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:52:35.882316    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:52:37.601384 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:52:37.601354    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:52:40.894493 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:52:40.894465    2568 scope.go:117] "RemoveContainer" containerID="68dedb59100ed45fc213461673d6d9d007f24f90c8cfdbfbb2eceda10f3e8891"
Sep 06 12:53:05.577590 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:05.577535    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:53:33.739158 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:33.739073    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vdjmj_86bc2130-aaf0-4c40-a3af-409723c43a58/server/0.log"
Sep 06 12:53:33.965406 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:33.965379    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4_8c040933-d571-4cce-a6bf-12ae30bfa457/copy-manifests/0.log"
Sep 06 12:53:33.972410 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:33.972384    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4_8c040933-d571-4cce-a6bf-12ae30bfa457/manager/0.log"
Sep 06 12:53:36.729812 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:36.729776    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz_37bf3739-7bbd-4568-aa84-f92fa40fae50/istio-proxy/0.log"
Sep 06 12:53:37.054910 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:37.054827    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766996c99d-qgb54_94c6aca3-cc78-414a-9019-0c3936432c3a/kube-auth-proxy/0.log"
Sep 06 12:53:38.094074 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:38.094036    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-gbn84_a742cdf4-9102-4ba5-85a9-623191054f26/main/0.log"
Sep 06 12:53:38.201899 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:38.201871    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-p6jpt_384ccc1c-be11-4902-ab85-bb54b287d13d/main/0.log"
Sep 06 12:53:38.307871 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:38.307838    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frpr8q_b3e09922-80c6-40fe-a945-48fa18b301a4/main/0.log"
Sep 06 12:53:38.533675 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:38.533650    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-8gcb2_1c8c2710-d959-499e-b895-313e9d9ecabc/main/0.log"
Sep 06 12:53:40.912871 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:40.912840    2568 scope.go:117] "RemoveContainer" containerID="4fe93dbdd7329b6330cce7ea8db67ac4d9b8d9158af26c3df63f1ffee4ed02a8"
Sep 06 12:53:40.920498 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:40.920480    2568 scope.go:117] "RemoveContainer" containerID="dd4b252b3d84e2367f4a1323862bdecce37025816db727d59f26231cffbfe6a0"
Sep 06 12:53:40.927684 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:40.927667    2568 scope.go:117] "RemoveContainer" containerID="b0190a315a41bd4eb54240c6b7860c35237b2d77f55764be16e531ba626084ca"
Sep 06 12:53:43.998322 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:43.998288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:53:44.092949 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:44.092920    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log" limit=1024
Sep 06 12:53:46.937648 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:46.937616    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g6tjq_bfe89a28-bbb4-475f-8219-d93d063bc226/global-pull-secret-syncer/0.log"
Sep 06 12:53:47.029077 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:47.029048    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4mmjh_22d4a411-4b50-431e-9719-f9c92e0064b2/konnectivity-agent/0.log"
Sep 06 12:53:47.173383 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:47.173358    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-80.ec2.internal_d6303ebc88473edaa1e2fd9f6ceeefbf/haproxy/0.log"
Sep 06 12:53:53.798510 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:53.798478    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dfjm6_161c1b4f-a708-4bba-97ca-9ee00412bfa2/node-exporter/0.log"
Sep 06 12:53:53.816500 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:53.816477    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dfjm6_161c1b4f-a708-4bba-97ca-9ee00412bfa2/kube-rbac-proxy/0.log"
Sep 06 12:53:53.849466 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:53.849443    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dfjm6_161c1b4f-a708-4bba-97ca-9ee00412bfa2/init-textfile/0.log"
Sep 06 12:53:57.267389 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267359    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"]
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267646    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1faa4c7d-9a80-4276-ab89-8a965634e196" containerName="payload-pre-processing"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267661    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1faa4c7d-9a80-4276-ab89-8a965634e196" containerName="payload-pre-processing"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267675    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267681    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267689    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267694    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267704    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267709    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267716    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267721    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267730    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a99b836-f103-4022-8e23-09906500e7df" containerName="revoke-keys"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267735    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a99b836-f103-4022-8e23-09906500e7df" containerName="revoke-keys"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267782    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1faa4c7d-9a80-4276-ab89-8a965634e196" containerName="payload-pre-processing"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267789    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267795    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="db785ea4-d387-4946-8efe-85b568477c80" containerName="istio-proxy"
Sep 06 12:53:57.267797 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267800    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a99b836-f103-4022-8e23-09906500e7df" containerName="revoke-keys"
Sep 06 12:53:57.268286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267807    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy"
Sep 06 12:53:57.268286 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.267812    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac86de8-6ec3-4ad7-819a-ec58ec0fa1a6" containerName="istio-proxy"
Sep 06 12:53:57.270704 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.270684    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.272810 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.272787    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6h8m\"/\"kube-root-ca.crt\""
Sep 06 12:53:57.273435 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.273416    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6h8m\"/\"openshift-service-ca.crt\""
Sep 06 12:53:57.273522 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.273447    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q6h8m\"/\"default-dockercfg-lf5lq\""
Sep 06 12:53:57.278650 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.278630    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"]
Sep 06 12:53:57.393328 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.393298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-proc\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.393429 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.393338    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96qvk\" (UniqueName: \"kubernetes.io/projected/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-kube-api-access-96qvk\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.393501 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.393438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-podres\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.393553 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.393502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-lib-modules\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.393553 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.393539    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-sys\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494071 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-lib-modules\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494188 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494081    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-sys\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494188 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494121    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-proc\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494188 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96qvk\" (UniqueName: \"kubernetes.io/projected/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-kube-api-access-96qvk\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494191    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-sys\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-proc\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494212    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-lib-modules\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494324 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494241    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-podres\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.494464 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.494355    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-podres\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.501672 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.501648    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96qvk\" (UniqueName: \"kubernetes.io/projected/a0b2d1a6-37d3-465e-a08e-a588a70e1c4e-kube-api-access-96qvk\") pod \"perf-node-gather-daemonset-c7822\" (UID: \"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.580992 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.580941    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:57.849726 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:57.849661    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"]
Sep 06 12:53:57.852734 ip-10-0-134-80 kubenswrapper[2568]: W0906 12:53:57.852705    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda0b2d1a6_37d3_465e_a08e_a588a70e1c4e.slice/crio-446beea92929436149fef659f56cda16c13fcc3059958efe118fac9d013488c0 WatchSource:0}: Error finding container 446beea92929436149fef659f56cda16c13fcc3059958efe118fac9d013488c0: Status 404 returned error can't find the container with id 446beea92929436149fef659f56cda16c13fcc3059958efe118fac9d013488c0
Sep 06 12:53:58.404253 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:58.404226    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822" event={"ID":"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e","Type":"ContainerStarted","Data":"77c48379f542217af2ebf07c9e056a1fca1bb4bbc525decac7dc193ab9e8ade7"}
Sep 06 12:53:58.404580 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:58.404272    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822" event={"ID":"a0b2d1a6-37d3-465e-a08e-a588a70e1c4e","Type":"ContainerStarted","Data":"446beea92929436149fef659f56cda16c13fcc3059958efe118fac9d013488c0"}
Sep 06 12:53:58.404580 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:58.404361    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:53:58.418554 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:58.418511    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822" podStartSLOduration=1.418495061 podStartE2EDuration="1.418495061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:53:58.41741665 +0000 UTC m=+2178.391463846" watchObservedRunningTime="2026-09-06 12:53:58.418495061 +0000 UTC m=+2178.392542247"
Sep 06 12:53:59.135303 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:59.135283    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rv585_0db9dffc-e714-49ad-b065-f3d1ce3a3562/dns/0.log"
Sep 06 12:53:59.154722 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:59.154699    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rv585_0db9dffc-e714-49ad-b065-f3d1ce3a3562/kube-rbac-proxy/0.log"
Sep 06 12:53:59.174776 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:59.174753    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59v9r_e32fc3b0-b1a7-4e08-83e7-3779065e0a6e/dns-node-resolver/0.log"
Sep 06 12:53:59.782785 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:59.782754    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69b86fc7f4-gd8gc_26f41fbe-9998-4fa2-8346-3c355e8befae/registry/0.log"
Sep 06 12:53:59.802137 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:53:59.802109    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lfrbv_13171d83-fc1e-4f9b-b75a-edadb8cff3da/node-ca/0.log"
Sep 06 12:54:00.796844 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:00.796796    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz_37bf3739-7bbd-4568-aa84-f92fa40fae50/istio-proxy/0.log"
Sep 06 12:54:01.115445 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:01.115384    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766996c99d-qgb54_94c6aca3-cc78-414a-9019-0c3936432c3a/kube-auth-proxy/0.log"
Sep 06 12:54:02.095185 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:02.095154    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5tlns_f36004a4-1edb-4a53-b195-19e6823b1cde/serve-healthcheck-canary/0.log"
Sep 06 12:54:02.607895 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:02.607866    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8h2nz_751d3825-8cdf-495d-817e-646d55879669/kube-rbac-proxy/0.log"
Sep 06 12:54:02.629009 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:02.628991    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8h2nz_751d3825-8cdf-495d-817e-646d55879669/exporter/0.log"
Sep 06 12:54:02.649493 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:02.649465    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8h2nz_751d3825-8cdf-495d-817e-646d55879669/extractor/0.log"
Sep 06 12:54:04.418434 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:04.418409    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-c7822"
Sep 06 12:54:05.220991 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:05.220964    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vdjmj_86bc2130-aaf0-4c40-a3af-409723c43a58/server/0.log"
Sep 06 12:54:05.320079 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:05.320057    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4_8c040933-d571-4cce-a6bf-12ae30bfa457/manager/0.log"
Sep 06 12:54:05.337668 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:05.337645    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf7c58dfb-p8zj4_8c040933-d571-4cce-a6bf-12ae30bfa457/copy-manifests/0.log"
Sep 06 12:54:06.907096 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:06.907066    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c968668cd-2lv9k_911ab375-b54d-4fd7-87cf-05617b794bf2/manager/0.log"
Sep 06 12:54:06.957584 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:06.957561    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-p6n9z_9bf4c0ca-e3f9-4a34-a57f-171c9e6eac67/openshift-lws-operator/0.log"
Sep 06 12:54:07.810820 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:07.810793    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz_37bf3739-7bbd-4568-aa84-f92fa40fae50/istio-proxy/0.log"
Sep 06 12:54:08.100172 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:08.100094    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766996c99d-qgb54_94c6aca3-cc78-414a-9019-0c3936432c3a/kube-auth-proxy/0.log"
Sep 06 12:54:09.640377 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:09.640343    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xzkjz_37bf3739-7bbd-4568-aa84-f92fa40fae50/istio-proxy/0.log"
Sep 06 12:54:09.966411 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:09.966384    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766996c99d-qgb54_94c6aca3-cc78-414a-9019-0c3936432c3a/kube-auth-proxy/0.log"
Sep 06 12:54:11.968714 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:11.968685    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-q6h7b_f965a923-198f-4b53-a556-7910ccf00127/migrator/0.log"
Sep 06 12:54:11.985376 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:11.985346    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-q6h7b_f965a923-198f-4b53-a556-7910ccf00127/graceful-termination/0.log"
Sep 06 12:54:13.306392 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.306324    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-54lh8_7c8f16ac-746a-474f-ae8a-76c16a64aec1/kube-multus/0.log"
Sep 06 12:54:13.554160 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.554108    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcvxx_2564df60-c9eb-4e85-82df-d44f54880bbb/kube-multus-additional-cni-plugins/0.log"
Sep 06 12:54:13.572522 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.572457    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcvxx_2564df60-c9eb-4e85-82df-d44f54880bbb/egress-router-binary-copy/0.log"
Sep 06 12:54:13.589516 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.589493    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcvxx_2564df60-c9eb-4e85-82df-d44f54880bbb/cni-plugins/0.log"
Sep 06 12:54:13.607274 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.607250    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcvxx_2564df60-c9eb-4e85-82df-d44f54880bbb/bond-cni-plugin/0.log"
Sep 06 12:54:13.625101 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.625084    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcvxx_2564df60-c9eb-4e85-82df-d44f54880bbb/routeoverride-cni/0.log"
Sep 06 12:54:13.643312 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.643293    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcvxx_2564df60-c9eb-4e85-82df-d44f54880bbb/whereabouts-cni-bincopy/0.log"
Sep 06 12:54:13.661683 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.661665    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rcvxx_2564df60-c9eb-4e85-82df-d44f54880bbb/whereabouts-cni/0.log"
Sep 06 12:54:13.812246 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.812228    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dzk4s_8e72a897-0d80-4d6c-bf8b-ad1287fe621e/network-metrics-daemon/0.log"
Sep 06 12:54:13.825847 ip-10-0-134-80 kubenswrapper[2568]: I0906 12:54:13.825790    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dzk4s_8e72a897-0d80-4d6c-bf8b-ad1287fe621e/kube-rbac-proxy/0.log"