Sep 15 11:38:22.156501 ip-10-0-139-13 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 11:38:22.559517 ip-10-0-139-13 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:38:22.559517 ip-10-0-139-13 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 11:38:22.559517 ip-10-0-139-13 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:38:22.559517 ip-10-0-139-13 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 11:38:22.559517 ip-10-0-139-13 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:38:22.560194 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.559575    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 11:38:22.565053 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565038    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:38:22.565053 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565053    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565056    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565060    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565063    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565066    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565069    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565072    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565077    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565081    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565084    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565087    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565089    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565092    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565095    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565098    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565100    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565103    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565106    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565109    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565111    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:38:22.565116 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565115    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565118    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565121    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565124    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565127    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565130    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565133    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565135    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565138    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565140    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565143    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565146    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565148    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565151    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565153    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565156    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565159    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565161    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565164    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565168    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:38:22.565618 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565171    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565174    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565177    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565180    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565183    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565185    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565188    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565191    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565194    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565196    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565199    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565202    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565204    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565211    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565214    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565227    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565230    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565234    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565236    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:38:22.566109 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565239    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565242    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565244    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565247    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565250    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565253    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565255    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565258    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565261    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565264    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565266    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565269    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565271    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565276    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565279    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565282    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565285    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565288    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565291    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:38:22.566589 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565294    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565297    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565299    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565302    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565304    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565307    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565310    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565313    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565317    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565320    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565322    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565325    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565328    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565332    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565336    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565338    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565341    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565344    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565346    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.565349    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:38:22.567036 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566047    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566053    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566056    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566058    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566061    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566064    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566067    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566070    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566072    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566075    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566077    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566080    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566083    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566085    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566088    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566092    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566097    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566100    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:38:22.567556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566103    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566106    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566109    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566120    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566123    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566126    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566128    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566131    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566134    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566136    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566139    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566142    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566144    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566148    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566152    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566155    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566157    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566160    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566163    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:38:22.568007 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566165    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566168    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566170    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566173    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566175    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566178    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566180    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566183    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566185    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566188    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566190    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566193    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566195    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566198    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566200    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566204    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566207    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566229    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566232    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566235    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:38:22.568566 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566237    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566240    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566243    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566246    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566248    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566251    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566253    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566256    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566259    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566261    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566264    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566266    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566269    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566272    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566275    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566278    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566280    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566283    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566285    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566288    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:38:22.569064 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566290    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566293    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566295    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566298    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566300    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566303    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566306    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566309    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566312    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566314    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566323    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566325    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566333    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566336    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566338    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566341    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566344    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566346    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566349    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566351    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:38:22.569577 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566354    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566356    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566775    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566780    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566783    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566786    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566789    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566792    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566795    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566798    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566801    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566804    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566807    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566810    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566812    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566815    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566818    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566820    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566825    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566828    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:38:22.570073 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566831    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566834    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566844    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566849    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566851    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566854    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566857    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566862    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566865    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566867    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566870    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566873    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566875    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566878    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566882    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566885    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566887    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566889    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566892    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:38:22.570581 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566895    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566897    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566900    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566902    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566905    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566907    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566910    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566912    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566915    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566917    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566920    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566924    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566927    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566930    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566932    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566935    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566943    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566946    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566948    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566951    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:38:22.571068 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566953    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566956    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566958    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566961    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566963    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566966    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566969    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566971    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566974    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566976    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566979    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566981    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566984    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566986    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566990    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566994    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.566997    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567000    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567002    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:38:22.571609 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567005    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567009    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567012    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567015    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567019    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567022    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567025    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567028    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567031    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567033    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567037    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567040    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567043    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567046    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567049    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567051    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567054    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567057    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567060    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:38:22.572059 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567062    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567065    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567068    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567070    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567141    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567175    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567184    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567189    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567193    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567196    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567200    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567204    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567207    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567210    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567214    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567230    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567233    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567237    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567241    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567244    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567247    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567250    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567256    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567259    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 11:38:22.572573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567268    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567271    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567274    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567278    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567281    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567284    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567287    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567290    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567293    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567295    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567298    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567301    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567306    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567309    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567311    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567314    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567317    2564 flags.go:64] FLAG: --enable-server="true"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567320    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567324    2564 flags.go:64] FLAG: --event-burst="100"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567327    2564 flags.go:64] FLAG: --event-qps="50"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567338    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567342    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567345    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567349    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 11:38:22.573162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567352    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567355    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567360    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567363    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567366    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567369    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567372    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567374    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567377    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567381    2564 flags.go:64] FLAG: --feature-gates=""
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567385    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567388    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567391    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567394    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567398    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567401    2564 flags.go:64] FLAG: --help="false"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567404    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567407    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567410    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567413    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567416    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567419    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567422    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 11:38:22.573810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567425    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567428    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567431    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567434    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567437    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567439    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567442    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567445    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567448    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567451    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567454    2564 flags.go:64] FLAG: --lock-file=""
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567458    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567461    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567464    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567469    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567472    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567475    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567478    2564 flags.go:64] FLAG: --logging-format="text"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567481    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567488    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567491    2564 flags.go:64] FLAG: --manifest-url=""
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567493    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567497    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567501    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567507    2564 flags.go:64] FLAG: --max-pods="110"
Sep 15 11:38:22.574548 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567510    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567513    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567516    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567519    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567522    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567525    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567528    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567534    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567537    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567540    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567543    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567546    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567551    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567554    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567557    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567560    2564 flags.go:64] FLAG: --port="10250"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567563    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567566    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-064633caf6aec8602"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567569    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567573    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567576    2564 flags.go:64] FLAG: --register-node="true"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567579    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567583    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567586    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 15 11:38:22.575510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567589    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567592    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567595    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567604    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567607    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567610    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567613    2564 flags.go:64] FLAG: --runonce="false"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567615    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567618    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567621    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567624    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567627    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567631    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567634    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567637    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567640    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567643    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567646    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567648    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567652    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567655    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567657    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567662    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567665    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567668    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 11:38:22.576093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567672    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567674    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567679    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567684    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567687    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567690    2564 flags.go:64] FLAG: --v="2"
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567694    2564 flags.go:64] FLAG: --version="false"
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567698    2564 flags.go:64] FLAG: --vmodule=""
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567701    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.567705    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567840    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567845    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567848    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567851    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567853    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567856    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567860    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567862    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567865    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567869    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567872    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567875    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:38:22.576718 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567877    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567880    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567883    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567885    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567888    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567891    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567893    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567896    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567898    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567901    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567903    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567906    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567910    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567912    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567915    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567917    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567920    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567923    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567925    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567928    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:38:22.577333 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567930    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567933    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567936    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567938    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567941    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567943    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567946    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567948    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567952    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567957    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567960    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567964    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567967    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567969    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567972    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567974    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567977    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567979    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567982    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567985    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:38:22.577859 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567987    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567990    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567993    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567995    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.567999    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568002    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568004    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568007    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568010    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568012    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568015    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568018    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568021    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568023    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568027    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568031    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568033    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568037    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568040    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:38:22.578371 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568043    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568045    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568050    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568052    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568055    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568057    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568060    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568063    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568066    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568068    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568071    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568073    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568076    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568079    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568082    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568084    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568087    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568091    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568095    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:38:22.578832 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568098    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568101    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568104    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568107    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568110    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568113    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568116    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568118    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.568121    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.568693    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.576389    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.576404    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.577261    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.577270    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 11:38:22.579317 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577330    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577335    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577338    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577342    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577345    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577349    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577351    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577354    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577357    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577360    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577363    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577365    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577368    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577371    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577374    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577377    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577379    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577382    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577384    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577387    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:38:22.579680 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577390    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577393    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577396    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577398    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577401    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577404    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577406    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577409    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577412    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577415    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577418    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577421    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577423    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577426    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577429    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577432    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577434    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577437    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577440    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:38:22.580173 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577442    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577447    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577450    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577453    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577456    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577460    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577463    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577467    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577470    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577473    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577476    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577479    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577482    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577485    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577488    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577491    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577493    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577496    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577498    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:38:22.580647 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577501    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577504    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577506    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577510    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577514    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577518    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577520    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577523    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577525    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577528    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577531    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577533    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577536    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577538    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577541    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577543    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577546    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577548    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577551    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:38:22.581147 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577553    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577556    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577559    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577562    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577564    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577567    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577570    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577572    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577574    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577577    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577579    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577582    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577584    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577587    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577589    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577591    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577595    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577598    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577601    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:38:22.581692 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577603    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577606    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577609    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.577614    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577730    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577736    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577739    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577742    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577745    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577748    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577751    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577754    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577756    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577759    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577762    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:38:22.582155 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577765    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577770    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577773    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577776    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577779    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577781    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577784    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577787    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577789    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577792    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577794    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577797    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577799    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577802    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577805    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577808    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577810    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577813    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577816    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577818    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:38:22.582537 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577821    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577824    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577827    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577829    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577832    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577834    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577837    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577840    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577843    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577845    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577848    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577850    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577853    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577855    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577859    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577862    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577865    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577868    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577870    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:38:22.583015 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577873    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577877    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577880    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577883    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577886    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577889    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577892    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577895    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577898    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577900    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577903    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577905    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577909    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577911    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577914    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577917    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577919    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577922    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577924    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:38:22.583485 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577927    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577929    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577932    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577934    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577937    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577940    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577944    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577947    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577949    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577953    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577956    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577958    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577961    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577964    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577966    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577969    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577971    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577974    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577977    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577979    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:38:22.583940 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577982    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577985    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577988    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577990    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577993    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577996    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.577998    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.578001    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.578003    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:22.578006    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.578011    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.578112    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.580622    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.581540    2564 server.go:1019] "Starting client certificate rotation"
Sep 15 11:38:22.584436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.581643    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:38:22.584773 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.581677    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:38:22.584773 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.583944    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:38:22.588859 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.588842    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:38:22.598283 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.598266    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 15 11:38:22.602620 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.602603    2564 log.go:25] "Validated CRI v1 image API"
Sep 15 11:38:22.603477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.603461    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 11:38:22.606919 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.606896    2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 945dec66-15b9-45a2-8fae-b871762f5cab:/dev/nvme0n1p4 9f3c0971-95f4-4002-aba2-3d770c8bb279:/dev/nvme0n1p3]
Sep 15 11:38:22.606999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.606916    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 11:38:22.612886 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.612772    2564 manager.go:216] Machine: {Timestamp:2026-09-15 11:38:22.611515468 +0000 UTC m=+0.335257146 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110853 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20035dc5636da2430498fe08dc6571 SystemUUID:ec20035d-c563-6da2-4304-98fe08dc6571 BootID:403a71af-ed4d-47f7-90ee-93deec59e522 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fe:af:08:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fe:af:08:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:0a:da:cb:ba:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 11:38:22.612886 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.612882    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 11:38:22.612979 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.612959    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 11:38:22.616308 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.616279    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 11:38:22.616367 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.616353    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:38:22.616444 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.616313    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-13.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 11:38:22.617034 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.617025    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 11:38:22.617066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.617036    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 11:38:22.617066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.617043    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:38:22.617629 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.617619    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:38:22.618440 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.618427    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 11:38:22.622159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.622147    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:38:22.622311 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.622301    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 11:38:22.622344 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.622331    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 11:38:22.622379 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.622345    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 11:38:22.622379 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.622357    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 11:38:22.622379 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.622369    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 15 11:38:22.622379 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.622378    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 11:38:22.623448 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.623426    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:38:22.623528 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.623466    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:38:22.626389 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.626368    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 11:38:22.628487 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.628472    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 11:38:22.628562 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.628502    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 11:38:22.630009 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.629998    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630014    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630020    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630025    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630033    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630038    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630052    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630057    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630063    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 11:38:22.630069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630068    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 11:38:22.630327 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630077    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 11:38:22.630327 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.630082    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 11:38:22.631534 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.631524    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 11:38:22.631534 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.631535    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 11:38:22.634308 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.634287    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 11:38:22.634308 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.634294    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-13.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 11:38:22.634386 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.634318    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-13.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 11:38:22.635396 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.635383    2564 server.go:1268] "Started kubelet"
Sep 15 11:38:22.635493 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.635463    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 11:38:22.635653 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.635466    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 11:38:22.635706 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.635685    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 11:38:22.636094 ip-10-0-139-13 systemd[1]: Started Kubernetes Kubelet.
Sep 15 11:38:22.637264 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.637246    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 11:38:22.638080 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.638068    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 11:38:22.640771 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.640753    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 11:38:22.642540 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.642522    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 11:38:22.643103 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.643088    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 11:38:22.643315 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.643208    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:22.643647 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.643628    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 11:38:22.643734 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.643628    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 11:38:22.643734 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.643663    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 11:38:22.643850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.643771    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 11:38:22.643850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.643778    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 11:38:22.645029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.644347    2564 factory.go:153] Registering CRI-O factory
Sep 15 11:38:22.645029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.644364    2564 factory.go:223] Registration of the crio container factory successfully
Sep 15 11:38:22.645029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.644416    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 11:38:22.645029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.644428    2564 factory.go:55] Registering systemd factory
Sep 15 11:38:22.645029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.644437    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 15 11:38:22.645029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.644452    2564 factory.go:103] Registering Raw factory
Sep 15 11:38:22.645029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.644464    2564 manager.go:1196] Started watching for new ooms in manager
Sep 15 11:38:22.645029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.644869    2564 manager.go:349] Starting recovery of all containers
Sep 15 11:38:22.651869 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.651839    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 11:38:22.652511 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.652483    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-13.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 11:38:22.654740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.654699    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 11:38:22.655018 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.652172    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-13.ec2.internal.18d57b9405fb11ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-13.ec2.internal,UID:ip-10-0-139-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-13.ec2.internal,},FirstTimestamp:2026-09-15 11:38:22.635356618 +0000 UTC m=+0.359098294,LastTimestamp:2026-09-15 11:38:22.635356618 +0000 UTC m=+0.359098294,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-13.ec2.internal,}"
Sep 15 11:38:22.656056 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.656038    2564 manager.go:354] Recovery completed
Sep 15 11:38:22.660943 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.660929    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:38:22.663026 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.663010    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:38:22.663092 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.663039    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:38:22.663092 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.663051    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:38:22.663654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.663637    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 11:38:22.663654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.663653    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 11:38:22.663777 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.663671    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:38:22.663777 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.663675    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:38:22.664381 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.664366    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:38:22.664448 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.664394    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:38:22.664448 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.664404    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:38:22.665263 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.665160    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-13.ec2.internal.18d57b9407a1452a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-13.ec2.internal,UID:ip-10-0-139-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-13.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-13.ec2.internal,},FirstTimestamp:2026-09-15 11:38:22.663025962 +0000 UTC m=+0.386767639,LastTimestamp:2026-09-15 11:38:22.663025962 +0000 UTC m=+0.386767639,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-13.ec2.internal,}"
Sep 15 11:38:22.666747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.666730    2564 policy_none.go:49] "None policy: Start"
Sep 15 11:38:22.666747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.666748    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 11:38:22.666884 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.666761    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 11:38:22.668701 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.668688    2564 policy_none.go:47] "Start"
Sep 15 11:38:22.670490 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.670470    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z784c"
Sep 15 11:38:22.672319 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.672256    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-13.ec2.internal.18d57b9407a18bb0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-13.ec2.internal,UID:ip-10-0-139-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-13.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-13.ec2.internal,},FirstTimestamp:2026-09-15 11:38:22.663044016 +0000 UTC m=+0.386785693,LastTimestamp:2026-09-15 11:38:22.663044016 +0000 UTC m=+0.386785693,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-13.ec2.internal,}"
Sep 15 11:38:22.674438 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.674381    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-13.ec2.internal.18d57b9407a1bd1d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-13.ec2.internal,UID:ip-10-0-139-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-13.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-13.ec2.internal,},FirstTimestamp:2026-09-15 11:38:22.663056669 +0000 UTC m=+0.386798346,LastTimestamp:2026-09-15 11:38:22.663056669 +0000 UTC m=+0.386798346,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-13.ec2.internal,}"
Sep 15 11:38:22.679433 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.679408    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z784c"
Sep 15 11:38:22.680879 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.680817    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-13.ec2.internal.18d57b9407a1452a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-13.ec2.internal.18d57b9407a1452a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-13.ec2.internal,UID:ip-10-0-139-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-13.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-13.ec2.internal,},FirstTimestamp:2026-09-15 11:38:22.663025962 +0000 UTC m=+0.386767639,LastTimestamp:2026-09-15 11:38:22.664380122 +0000 UTC m=+0.388121798,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-13.ec2.internal,}"
Sep 15 11:38:22.684931 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.684868    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-13.ec2.internal.18d57b9407a18bb0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-13.ec2.internal.18d57b9407a18bb0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-13.ec2.internal,UID:ip-10-0-139-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-13.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-13.ec2.internal,},FirstTimestamp:2026-09-15 11:38:22.663044016 +0000 UTC m=+0.386785693,LastTimestamp:2026-09-15 11:38:22.664398628 +0000 UTC m=+0.388140305,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-13.ec2.internal,}"
Sep 15 11:38:22.690852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.690836    2564 manager.go:337] "Starting Device Plugin manager"
Sep 15 11:38:22.690948 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.690884    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 11:38:22.690948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.690899    2564 server.go:87] "Starting device plugin registration server"
Sep 15 11:38:22.691162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.691143    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 11:38:22.691308 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.691159    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 11:38:22.691411 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.691346    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 11:38:22.691482 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.691415    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 11:38:22.691482 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.691423    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 11:38:22.692041 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.692023    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 11:38:22.692138 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.692086    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:22.749401 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.749380    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 11:38:22.749583 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.749438    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 11:38:22.749583 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.749464    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 11:38:22.749583 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.749510    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 11:38:22.751732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.751715    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:38:22.791527 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.791498    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:38:22.792567 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.792546    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:38:22.792675 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.792585    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:38:22.792675 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.792600    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:38:22.792675 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.792624    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.801499 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.801478    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.801579 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.801504    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-13.ec2.internal\": node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:22.845398 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.845341    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:22.850418 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.850400    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal"]
Sep 15 11:38:22.850466 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.850461    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:38:22.851794 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.851777    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:38:22.851887 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.851811    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:38:22.851887 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.851825    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:38:22.854229 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854200    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:38:22.854321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854305    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.854368 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854330    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:38:22.854936 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854923    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:38:22.854936 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854929    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:38:22.855058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854946    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:38:22.855058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854947    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:38:22.855058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854960    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:38:22.855058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.854981    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:38:22.857300 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.857284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.857350 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.857311    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:38:22.858007 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.857993    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:38:22.858078 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.858018    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:38:22.858078 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.858031    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:38:22.886828 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.886805    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-13.ec2.internal\" not found" node="ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.891149 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.891134    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-13.ec2.internal\" not found" node="ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.945491 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:22.945464    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:22.945491 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.945474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eb5ec72b0d941544dfed6815769df15-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal\" (UID: \"6eb5ec72b0d941544dfed6815769df15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.945636 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.945519    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb5ec72b0d941544dfed6815769df15-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal\" (UID: \"6eb5ec72b0d941544dfed6815769df15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:22.945636 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:22.945546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7927533a6c5893af59befd4fd5d6b4d6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-13.ec2.internal\" (UID: \"7927533a6c5893af59befd4fd5d6b4d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.045757 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.045721    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:23.045757 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.045753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7927533a6c5893af59befd4fd5d6b4d6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-13.ec2.internal\" (UID: \"7927533a6c5893af59befd4fd5d6b4d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.045954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.045785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eb5ec72b0d941544dfed6815769df15-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal\" (UID: \"6eb5ec72b0d941544dfed6815769df15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.045954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.045808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb5ec72b0d941544dfed6815769df15-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal\" (UID: \"6eb5ec72b0d941544dfed6815769df15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.045954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.045839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7927533a6c5893af59befd4fd5d6b4d6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-13.ec2.internal\" (UID: \"7927533a6c5893af59befd4fd5d6b4d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.045954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.045841    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eb5ec72b0d941544dfed6815769df15-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal\" (UID: \"6eb5ec72b0d941544dfed6815769df15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.045954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.045839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb5ec72b0d941544dfed6815769df15-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal\" (UID: \"6eb5ec72b0d941544dfed6815769df15\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.146432 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.146343    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:23.189537 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.189504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.194406 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.194389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.247383 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.247212    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:23.347641 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.347615    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:23.447940 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.447912    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-13.ec2.internal\" not found"
Sep 15 11:38:23.531709 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.531682    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:38:23.544456 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.544432    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.561435 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.561417    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:38:23.563544 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.563530    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal"
Sep 15 11:38:23.570923 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.570909    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:38:23.581891 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.581873    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 11:38:23.581999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.581980    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:38:23.582063 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.582040    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:38:23.623576 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.623550    2564 apiserver.go:52] "Watching apiserver"
Sep 15 11:38:23.641366 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.641335    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 11:38:23.641731 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.641701    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-9xmv5","openshift-network-diagnostics/network-check-target-vvl2s","openshift-network-operator/iptables-alerter-6hmw6","openshift-ovn-kubernetes/ovnkube-node-dhh4d","kube-system/konnectivity-agent-7cwd2","kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n","openshift-cluster-node-tuning-operator/tuned-24zbk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal","openshift-multus/multus-k7tfm","kube-system/global-pull-secret-syncer-xmpv6","openshift-dns/node-resolver-dnzpv","openshift-image-registry/node-ca-r85f8","openshift-multus/multus-additional-cni-plugins-52wmm"]
Sep 15 11:38:23.643314 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.643288    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 11:38:23.644247 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.644214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.646690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.646666    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.646960 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.646926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 11:38:23.646960 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.646940    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fql47\""
Sep 15 11:38:23.647142 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.646961    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 11:38:23.647198 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.647162    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 11:38:23.648715 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648698    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 11:38:23.648797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.648868 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.648868 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-sys-fs\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.648961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-socket-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.648961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648910    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 11:38:23.648961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-registration-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.648961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-device-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.649147 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.648974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqgxx\" (UniqueName: \"kubernetes.io/projected/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-kube-api-access-hqgxx\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.649188 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.649168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.649608 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.649590    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9gjgj\""
Sep 15 11:38:23.649679 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.649593    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 11:38:23.651705 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.651690    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 11:38:23.651809 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.651746    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tlgxd\""
Sep 15 11:38:23.651809 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.651761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:38:23.651809 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.651780    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.651809 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.651801    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 11:38:23.654203 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.654183    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:23.654349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.654329    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 11:38:23.654349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.654345    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 11:38:23.654538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.654383    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-844l7\""
Sep 15 11:38:23.655446 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.655424    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 11:38:23.655539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.655460    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 11:38:23.655539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.655462    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 11:38:23.655539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.655481    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 11:38:23.655807 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.655791    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:38:23.656579 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.656564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.656669 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.656654    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 11:38:23.657101 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.657084    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dfnd5\""
Sep 15 11:38:23.657160 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.657100    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 11:38:23.658604 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.658588    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 11:38:23.658943 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.658928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.659040 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.659023    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 11:38:23.659378 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.659358    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 11:38:23.659467 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.659422    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 11:38:23.659467 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.659447    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qdc4d\""
Sep 15 11:38:23.659554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.659358    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 11:38:23.661552 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.661532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:23.661664 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.661611    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:23.661905 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.661881    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:38:23.661905 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.661898    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 11:38:23.662041 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.661951    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lvzb7\""
Sep 15 11:38:23.664736 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.664708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:23.664834 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.664809    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:23.667071 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.667046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.669533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.669514    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.669620 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.669577    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:23.669775 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.669758    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 11:38:23.670394 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.670379    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rsrml\""
Sep 15 11:38:23.672034 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.672008    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.677637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.677612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lvncp\""
Sep 15 11:38:23.678475 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.678455    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 11:38:23.678724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.678707    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 11:38:23.684382 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.684338    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 11:33:23 +0000 UTC" deadline="2028-06-07 03:39:30.333734852 +0000 UTC"
Sep 15 11:38:23.684382 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.684379    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15136h1m6.649358304s"
Sep 15 11:38:23.689874 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.689856    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n75cb"
Sep 15 11:38:23.702728 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.702666    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n75cb"
Sep 15 11:38:23.722907 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.722882    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:38:23.745105 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.745086    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 11:38:23.749791 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.749773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-cnibin\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.749856 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.749801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysctl-d\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.749856 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.749818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/458502f8-874a-4ba0-92bc-e749f3ad48e5-cni-binary-copy\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.749856 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.749840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-multus-certs\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.750016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.749882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-log-socket\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.749907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-cni-bin\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.749943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovn-node-metrics-cert\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.749977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlfjg\" (UniqueName: \"kubernetes.io/projected/4b84f20a-b049-4ff4-b9d5-e436b4095353-kube-api-access-nlfjg\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.750214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd080-edda-4fe9-8646-8d014cec7f64-tmp\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.750214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:23.750214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvpt\" (UniqueName: \"kubernetes.io/projected/1f9b74e0-7785-465e-ac87-49bc6a9693cd-kube-api-access-8cvpt\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.750214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovnkube-script-lib\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.750214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c57b79c9-b65f-42d1-9658-35ba792b0a1e-iptables-alerter-script\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.750214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-run-netns\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-var-lib-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-system-cni-dir\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-kubernetes\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbfg7\" (UniqueName: \"kubernetes.io/projected/458502f8-874a-4ba0-92bc-e749f3ad48e5-kube-api-access-xbfg7\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a75f6ca7-de6e-4186-8130-1dd5ce82c1df-agent-certs\") pod \"konnectivity-agent-7cwd2\" (UID: \"a75f6ca7-de6e-4186-8130-1dd5ce82c1df\") " pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovnkube-config\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-sys-fs\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-modprobe-d\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.750519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750520    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-sys-fs\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-conf-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-ovn\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-run\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-env-overrides\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-cnibin\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-k8s-cni-cncf-io\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwjn\" (UniqueName: \"kubernetes.io/projected/c57b79c9-b65f-42d1-9658-35ba792b0a1e-kube-api-access-cpwjn\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2cwm\" (UniqueName: \"kubernetes.io/projected/211172c5-1e71-459d-b57b-7a501cf3f4fb-kube-api-access-l2cwm\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750834    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.750851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqgxx\" (UniqueName: \"kubernetes.io/projected/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-kube-api-access-hqgxx\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750869    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750885    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5x2\" (UniqueName: \"kubernetes.io/projected/0f78406e-e9af-4add-800b-fc0102ec80fb-kube-api-access-kx5x2\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-cni-bin\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-kubelet\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-hostroot\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-etc-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.750979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-cni-netd\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysconfig\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7124cf81-448a-4016-887b-1753ecb7c9cc-kubelet-config\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a75f6ca7-de6e-4186-8130-1dd5ce82c1df-konnectivity-ca\") pod \"konnectivity-agent-7cwd2\" (UID: \"a75f6ca7-de6e-4186-8130-1dd5ce82c1df\") " pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-device-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-system-cni-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-cni-multus\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.751477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp7p8\" (UniqueName: \"kubernetes.io/projected/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-kube-api-access-pp7p8\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751212    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-device-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-cni-binary-copy\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7124cf81-448a-4016-887b-1753ecb7c9cc-dbus\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-var-lib-kubelet\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-socket-dir-parent\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-netns\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-etc-kubernetes\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-systemd-units\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-node-log\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-socket-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-registration-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-registration-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751641    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysctl-conf\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751638    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-socket-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.752159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-host\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751701    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5shf4\" (UniqueName: \"kubernetes.io/projected/4d9fd080-edda-4fe9-8646-8d014cec7f64-kube-api-access-5shf4\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f9b74e0-7785-465e-ac87-49bc6a9693cd-serviceca\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-kubelet\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-systemd\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-systemd\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-sys\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-tuned\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.751999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-daemon-config\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.752075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f9b74e0-7785-465e-ac87-49bc6a9693cd-host\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.752118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57b79c9-b65f-42d1-9658-35ba792b0a1e-host-slash\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.752142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f78406e-e9af-4add-800b-fc0102ec80fb-hosts-file\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.752164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-lib-modules\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.752185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-cni-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.752218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f78406e-e9af-4add-800b-fc0102ec80fb-tmp-dir\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.752760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.752288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-slash\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.762335 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.762284    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 11:38:23.765593 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.765570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqgxx\" (UniqueName: \"kubernetes.io/projected/e9b1898e-f5d5-4fa7-909b-e4c6f0155f01-kube-api-access-hqgxx\") pod \"aws-ebs-csi-driver-node-cjc5n\" (UID: \"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.802954 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:23.802921    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb5ec72b0d941544dfed6815769df15.slice/crio-519e26a25fc430282a00036c817cda0087f9355eac08638e127a82328a4caa49 WatchSource:0}: Error finding container 519e26a25fc430282a00036c817cda0087f9355eac08638e127a82328a4caa49: Status 404 returned error can't find the container with id 519e26a25fc430282a00036c817cda0087f9355eac08638e127a82328a4caa49
Sep 15 11:38:23.808724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.808703    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:38:23.853448 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-modprobe-d\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.853448 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-conf-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.853600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-ovn\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.853600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-run\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.853600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-env-overrides\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.853600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-conf-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.853600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-modprobe-d\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.853600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-cnibin\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.853600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-k8s-cni-cncf-io\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-ovn\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwjn\" (UniqueName: \"kubernetes.io/projected/c57b79c9-b65f-42d1-9658-35ba792b0a1e-kube-api-access-cpwjn\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-run\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-k8s-cni-cncf-io\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-cnibin\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853733    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.853760    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2cwm\" (UniqueName: \"kubernetes.io/projected/211172c5-1e71-459d-b57b-7a501cf3f4fb-kube-api-access-l2cwm\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.853834    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs podName:8b4bade6-b906-4b46-a9cc-72134fdfa6c3 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:24.353812687 +0000 UTC m=+2.077554371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs") pod "network-metrics-daemon-9xmv5" (UID: "8b4bade6-b906-4b46-a9cc-72134fdfa6c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5x2\" (UniqueName: \"kubernetes.io/projected/0f78406e-e9af-4add-800b-fc0102ec80fb-kube-api-access-kx5x2\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.853983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.853961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-cni-bin\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-env-overrides\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-kubelet\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-hostroot\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-cni-bin\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-etc-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-etc-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-cni-netd\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysconfig\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-cni-netd\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7124cf81-448a-4016-887b-1753ecb7c9cc-kubelet-config\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a75f6ca7-de6e-4186-8130-1dd5ce82c1df-konnectivity-ca\") pod \"konnectivity-agent-7cwd2\" (UID: \"a75f6ca7-de6e-4186-8130-1dd5ce82c1df\") " pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854280    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysconfig\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854329    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-kubelet\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-system-cni-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-cni-multus\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-system-cni-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.854966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp7p8\" (UniqueName: \"kubernetes.io/projected/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-kube-api-access-pp7p8\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-cni-binary-copy\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7124cf81-448a-4016-887b-1753ecb7c9cc-dbus\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-var-lib-kubelet\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-socket-dir-parent\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-netns\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-etc-kubernetes\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-systemd-units\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-node-log\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7124cf81-448a-4016-887b-1753ecb7c9cc-kubelet-config\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysctl-conf\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-host\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-var-lib-cni-multus\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5shf4\" (UniqueName: \"kubernetes.io/projected/4d9fd080-edda-4fe9-8646-8d014cec7f64-kube-api-access-5shf4\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-hostroot\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f9b74e0-7785-465e-ac87-49bc6a9693cd-serviceca\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-kubelet\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.855908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854714    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-var-lib-kubelet\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-systemd\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7124cf81-448a-4016-887b-1753ecb7c9cc-dbus\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-systemd\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-sys\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854789    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-etc-kubernetes\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-tuned\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854819    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-kubelet\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-daemon-config\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-socket-dir-parent\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-netns\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f9b74e0-7785-465e-ac87-49bc6a9693cd-host\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-host\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854756    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysctl-conf\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-run-systemd\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854833    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-systemd\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-systemd-units\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.856853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854933    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-node-log\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57b79c9-b65f-42d1-9658-35ba792b0a1e-host-slash\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.854989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f78406e-e9af-4add-800b-fc0102ec80fb-hosts-file\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-lib-modules\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0f78406e-e9af-4add-800b-fc0102ec80fb-hosts-file\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-cni-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f78406e-e9af-4add-800b-fc0102ec80fb-tmp-dir\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855105    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-slash\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-cnibin\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a75f6ca7-de6e-4186-8130-1dd5ce82c1df-konnectivity-ca\") pod \"konnectivity-agent-7cwd2\" (UID: \"a75f6ca7-de6e-4186-8130-1dd5ce82c1df\") " pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysctl-d\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57b79c9-b65f-42d1-9658-35ba792b0a1e-host-slash\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f9b74e0-7785-465e-ac87-49bc6a9693cd-host\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/458502f8-874a-4ba0-92bc-e749f3ad48e5-cni-binary-copy\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-lib-modules\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-multus-certs\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f9b74e0-7785-465e-ac87-49bc6a9693cd-serviceca\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855243    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-cni-dir\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.857827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-log-socket\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-slash\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-sys\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-cni-bin\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovn-node-metrics-cert\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/458502f8-874a-4ba0-92bc-e749f3ad48e5-host-run-multus-certs\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlfjg\" (UniqueName: \"kubernetes.io/projected/4b84f20a-b049-4ff4-b9d5-e436b4095353-kube-api-access-nlfjg\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-cnibin\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd080-edda-4fe9-8646-8d014cec7f64-tmp\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvpt\" (UniqueName: \"kubernetes.io/projected/1f9b74e0-7785-465e-ac87-49bc6a9693cd-kube-api-access-8cvpt\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovnkube-script-lib\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855467    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-sysctl-d\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.855250    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c57b79c9-b65f-42d1-9658-35ba792b0a1e-iptables-alerter-script\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f78406e-e9af-4add-800b-fc0102ec80fb-tmp-dir\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.858770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-run-netns\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b84f20a-b049-4ff4-b9d5-e436b4095353-cni-binary-copy\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.855614    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret podName:7124cf81-448a-4016-887b-1753ecb7c9cc nodeName:}" failed. No retries permitted until 2026-09-15 11:38:24.355565883 +0000 UTC m=+2.079307566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret") pod "global-pull-secret-syncer-xmpv6" (UID: "7124cf81-448a-4016-887b-1753ecb7c9cc") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-run-netns\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-cni-bin\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-var-lib-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-system-cni-dir\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-kubernetes\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855803    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbfg7\" (UniqueName: \"kubernetes.io/projected/458502f8-874a-4ba0-92bc-e749f3ad48e5-kube-api-access-xbfg7\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/458502f8-874a-4ba0-92bc-e749f3ad48e5-multus-daemon-config\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a75f6ca7-de6e-4186-8130-1dd5ce82c1df-agent-certs\") pod \"konnectivity-agent-7cwd2\" (UID: \"a75f6ca7-de6e-4186-8130-1dd5ce82c1df\") " pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b84f20a-b049-4ff4-b9d5-e436b4095353-system-cni-dir\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.855900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovnkube-config\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.856042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-kubernetes\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.859337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.856338    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovnkube-script-lib\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.856387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c57b79c9-b65f-42d1-9658-35ba792b0a1e-iptables-alerter-script\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.856440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-var-lib-openvswitch\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.856485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/211172c5-1e71-459d-b57b-7a501cf3f4fb-log-socket\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.856552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovnkube-config\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.856805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/458502f8-874a-4ba0-92bc-e749f3ad48e5-cni-binary-copy\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.857983    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.858214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd080-edda-4fe9-8646-8d014cec7f64-etc-tuned\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.858534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd080-edda-4fe9-8646-8d014cec7f64-tmp\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.858770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a75f6ca7-de6e-4186-8130-1dd5ce82c1df-agent-certs\") pod \"konnectivity-agent-7cwd2\" (UID: \"a75f6ca7-de6e-4186-8130-1dd5ce82c1df\") " pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:23.859812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.858838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/211172c5-1e71-459d-b57b-7a501cf3f4fb-ovn-node-metrics-cert\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.865226 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.865201    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:38:23.865343 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.865235    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:38:23.865343 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.865252    2564 projected.go:196] Error preparing data for projected volume kube-api-access-9zlg8 for pod openshift-network-diagnostics/network-check-target-vvl2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:23.865509 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:23.865346    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8 podName:8a7c5016-7365-40b4-b9e4-55a553a15b70 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:24.365327128 +0000 UTC m=+2.089068817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9zlg8" (UniqueName: "kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8") pod "network-check-target-vvl2s" (UID: "8a7c5016-7365-40b4-b9e4-55a553a15b70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:23.865634 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:23.865613    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7927533a6c5893af59befd4fd5d6b4d6.slice/crio-922b427f09efa83c468bfcb6506ee0884b1da462d9d3feea83cd39698d843950 WatchSource:0}: Error finding container 922b427f09efa83c468bfcb6506ee0884b1da462d9d3feea83cd39698d843950: Status 404 returned error can't find the container with id 922b427f09efa83c468bfcb6506ee0884b1da462d9d3feea83cd39698d843950
Sep 15 11:38:23.867063 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.867033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwjn\" (UniqueName: \"kubernetes.io/projected/c57b79c9-b65f-42d1-9658-35ba792b0a1e-kube-api-access-cpwjn\") pod \"iptables-alerter-6hmw6\" (UID: \"c57b79c9-b65f-42d1-9658-35ba792b0a1e\") " pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:23.867706 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.867617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlfjg\" (UniqueName: \"kubernetes.io/projected/4b84f20a-b049-4ff4-b9d5-e436b4095353-kube-api-access-nlfjg\") pod \"multus-additional-cni-plugins-52wmm\" (UID: \"4b84f20a-b049-4ff4-b9d5-e436b4095353\") " pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:23.868173 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.868152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp7p8\" (UniqueName: \"kubernetes.io/projected/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-kube-api-access-pp7p8\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:23.868889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.868476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2cwm\" (UniqueName: \"kubernetes.io/projected/211172c5-1e71-459d-b57b-7a501cf3f4fb-kube-api-access-l2cwm\") pod \"ovnkube-node-dhh4d\" (UID: \"211172c5-1e71-459d-b57b-7a501cf3f4fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:23.868889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.868748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5shf4\" (UniqueName: \"kubernetes.io/projected/4d9fd080-edda-4fe9-8646-8d014cec7f64-kube-api-access-5shf4\") pod \"tuned-24zbk\" (UID: \"4d9fd080-edda-4fe9-8646-8d014cec7f64\") " pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:23.869012 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.868884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5x2\" (UniqueName: \"kubernetes.io/projected/0f78406e-e9af-4add-800b-fc0102ec80fb-kube-api-access-kx5x2\") pod \"node-resolver-dnzpv\" (UID: \"0f78406e-e9af-4add-800b-fc0102ec80fb\") " pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:23.869617 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.869591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbfg7\" (UniqueName: \"kubernetes.io/projected/458502f8-874a-4ba0-92bc-e749f3ad48e5-kube-api-access-xbfg7\") pod \"multus-k7tfm\" (UID: \"458502f8-874a-4ba0-92bc-e749f3ad48e5\") " pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:23.869739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.869723    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvpt\" (UniqueName: \"kubernetes.io/projected/1f9b74e0-7785-465e-ac87-49bc6a9693cd-kube-api-access-8cvpt\") pod \"node-ca-r85f8\" (UID: \"1f9b74e0-7785-465e-ac87-49bc6a9693cd\") " pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:23.976283 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.976181    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n"
Sep 15 11:38:23.987085 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:23.987057    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b1898e_f5d5_4fa7_909b_e4c6f0155f01.slice/crio-e5fd22d27365be43027ba910b14112c7cc20505a4f1a786210accf068a25cb09 WatchSource:0}: Error finding container e5fd22d27365be43027ba910b14112c7cc20505a4f1a786210accf068a25cb09: Status 404 returned error can't find the container with id e5fd22d27365be43027ba910b14112c7cc20505a4f1a786210accf068a25cb09
Sep 15 11:38:23.992372 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:23.992350    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r85f8"
Sep 15 11:38:24.000882 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:24.000856    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9b74e0_7785_465e_ac87_49bc6a9693cd.slice/crio-4d005ab33decab446ca4d8a17c375fb629f36455599cc76e55ef1fe9e1faf29c WatchSource:0}: Error finding container 4d005ab33decab446ca4d8a17c375fb629f36455599cc76e55ef1fe9e1faf29c: Status 404 returned error can't find the container with id 4d005ab33decab446ca4d8a17c375fb629f36455599cc76e55ef1fe9e1faf29c
Sep 15 11:38:24.003978 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.003954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6hmw6"
Sep 15 11:38:24.012621 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:24.012593    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57b79c9_b65f_42d1_9658_35ba792b0a1e.slice/crio-d42dd88763eaf32d555601a16e3ad10a8271b38b6fd85473dff64071b97e8570 WatchSource:0}: Error finding container d42dd88763eaf32d555601a16e3ad10a8271b38b6fd85473dff64071b97e8570: Status 404 returned error can't find the container with id d42dd88763eaf32d555601a16e3ad10a8271b38b6fd85473dff64071b97e8570
Sep 15 11:38:24.020857 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.020826    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:24.029288 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:24.029265    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211172c5_1e71_459d_b57b_7a501cf3f4fb.slice/crio-43edf277eb89081130417857d3cf6d9ef675945b3af476a1c9c87ac5969a1557 WatchSource:0}: Error finding container 43edf277eb89081130417857d3cf6d9ef675945b3af476a1c9c87ac5969a1557: Status 404 returned error can't find the container with id 43edf277eb89081130417857d3cf6d9ef675945b3af476a1c9c87ac5969a1557
Sep 15 11:38:24.036483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.036464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:24.042406 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.042368    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52wmm"
Sep 15 11:38:24.045005 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:24.044984    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75f6ca7_de6e_4186_8130_1dd5ce82c1df.slice/crio-395309eea026b9df8108a3d1b5e360741e1e66173a498dc9e93f3da23e46226f WatchSource:0}: Error finding container 395309eea026b9df8108a3d1b5e360741e1e66173a498dc9e93f3da23e46226f: Status 404 returned error can't find the container with id 395309eea026b9df8108a3d1b5e360741e1e66173a498dc9e93f3da23e46226f
Sep 15 11:38:24.050912 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:24.050886    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b84f20a_b049_4ff4_b9d5_e436b4095353.slice/crio-7b8429c71e11b6e930010faaaa62749a25888876787a760b0f860da17312efea WatchSource:0}: Error finding container 7b8429c71e11b6e930010faaaa62749a25888876787a760b0f860da17312efea: Status 404 returned error can't find the container with id 7b8429c71e11b6e930010faaaa62749a25888876787a760b0f860da17312efea
Sep 15 11:38:24.056013 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.055994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24zbk"
Sep 15 11:38:24.060871 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.060852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k7tfm"
Sep 15 11:38:24.065316 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:24.065284    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9fd080_edda_4fe9_8646_8d014cec7f64.slice/crio-8420490f001225c42676dbff96ede9c9c45ac1ef672eb5a3241e40c9652b7aa8 WatchSource:0}: Error finding container 8420490f001225c42676dbff96ede9c9c45ac1ef672eb5a3241e40c9652b7aa8: Status 404 returned error can't find the container with id 8420490f001225c42676dbff96ede9c9c45ac1ef672eb5a3241e40c9652b7aa8
Sep 15 11:38:24.070289 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:24.070264    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458502f8_874a_4ba0_92bc_e749f3ad48e5.slice/crio-f701d1ace73bcdcf10bca8ec543256a06698e831a3b3c4255f5bf95bb813d8c0 WatchSource:0}: Error finding container f701d1ace73bcdcf10bca8ec543256a06698e831a3b3c4255f5bf95bb813d8c0: Status 404 returned error can't find the container with id f701d1ace73bcdcf10bca8ec543256a06698e831a3b3c4255f5bf95bb813d8c0
Sep 15 11:38:24.078419 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.078403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnzpv"
Sep 15 11:38:24.087596 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:24.087576    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f78406e_e9af_4add_800b_fc0102ec80fb.slice/crio-07d3aca3e06dab39933853fb5d43e0e046f24c436569cb438f54d0287003c6c8 WatchSource:0}: Error finding container 07d3aca3e06dab39933853fb5d43e0e046f24c436569cb438f54d0287003c6c8: Status 404 returned error can't find the container with id 07d3aca3e06dab39933853fb5d43e0e046f24c436569cb438f54d0287003c6c8
Sep 15 11:38:24.360203 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.360100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:24.360203 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.360174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:24.360420 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:24.360287    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:24.360420 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:24.360314    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:24.360420 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:24.360360    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret podName:7124cf81-448a-4016-887b-1753ecb7c9cc nodeName:}" failed. No retries permitted until 2026-09-15 11:38:25.360341193 +0000 UTC m=+3.084082860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret") pod "global-pull-secret-syncer-xmpv6" (UID: "7124cf81-448a-4016-887b-1753ecb7c9cc") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:24.360420 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:24.360376    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs podName:8b4bade6-b906-4b46-a9cc-72134fdfa6c3 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:25.360367934 +0000 UTC m=+3.084109601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs") pod "network-metrics-daemon-9xmv5" (UID: "8b4bade6-b906-4b46-a9cc-72134fdfa6c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:24.460929 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.460892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:24.461264 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:24.461141    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:38:24.461264 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:24.461178    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:38:24.461264 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:24.461193    2564 projected.go:196] Error preparing data for projected volume kube-api-access-9zlg8 for pod openshift-network-diagnostics/network-check-target-vvl2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:24.461479 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:24.461274    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8 podName:8a7c5016-7365-40b4-b9e4-55a553a15b70 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:25.461237465 +0000 UTC m=+3.184979134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zlg8" (UniqueName: "kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8") pod "network-check-target-vvl2s" (UID: "8a7c5016-7365-40b4-b9e4-55a553a15b70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:24.656135 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.656055    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:38:24.706635 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.706391    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:33:24 +0000 UTC" deadline="2028-06-18 19:51:19.91873961 +0000 UTC"
Sep 15 11:38:24.706635 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.706456    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15416h12m55.212287743s"
Sep 15 11:38:24.794315 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.780728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k7tfm" event={"ID":"458502f8-874a-4ba0-92bc-e749f3ad48e5","Type":"ContainerStarted","Data":"f701d1ace73bcdcf10bca8ec543256a06698e831a3b3c4255f5bf95bb813d8c0"}
Sep 15 11:38:24.794315 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.790783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7cwd2" event={"ID":"a75f6ca7-de6e-4186-8130-1dd5ce82c1df","Type":"ContainerStarted","Data":"395309eea026b9df8108a3d1b5e360741e1e66173a498dc9e93f3da23e46226f"}
Sep 15 11:38:24.794526 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.794377    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r85f8" event={"ID":"1f9b74e0-7785-465e-ac87-49bc6a9693cd","Type":"ContainerStarted","Data":"4d005ab33decab446ca4d8a17c375fb629f36455599cc76e55ef1fe9e1faf29c"}
Sep 15 11:38:24.817319 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.804502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n" event={"ID":"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01","Type":"ContainerStarted","Data":"e5fd22d27365be43027ba910b14112c7cc20505a4f1a786210accf068a25cb09"}
Sep 15 11:38:24.823262 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.822771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24zbk" event={"ID":"4d9fd080-edda-4fe9-8646-8d014cec7f64","Type":"ContainerStarted","Data":"8420490f001225c42676dbff96ede9c9c45ac1ef672eb5a3241e40c9652b7aa8"}
Sep 15 11:38:24.844219 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.844186    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerStarted","Data":"7b8429c71e11b6e930010faaaa62749a25888876787a760b0f860da17312efea"}
Sep 15 11:38:24.851883 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.851841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"43edf277eb89081130417857d3cf6d9ef675945b3af476a1c9c87ac5969a1557"}
Sep 15 11:38:24.858813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.858730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6hmw6" event={"ID":"c57b79c9-b65f-42d1-9658-35ba792b0a1e","Type":"ContainerStarted","Data":"d42dd88763eaf32d555601a16e3ad10a8271b38b6fd85473dff64071b97e8570"}
Sep 15 11:38:24.884551 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.884521    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal" event={"ID":"7927533a6c5893af59befd4fd5d6b4d6","Type":"ContainerStarted","Data":"922b427f09efa83c468bfcb6506ee0884b1da462d9d3feea83cd39698d843950"}
Sep 15 11:38:24.898342 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.898313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal" event={"ID":"6eb5ec72b0d941544dfed6815769df15","Type":"ContainerStarted","Data":"519e26a25fc430282a00036c817cda0087f9355eac08638e127a82328a4caa49"}
Sep 15 11:38:24.907429 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:24.907362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnzpv" event={"ID":"0f78406e-e9af-4add-800b-fc0102ec80fb","Type":"ContainerStarted","Data":"07d3aca3e06dab39933853fb5d43e0e046f24c436569cb438f54d0287003c6c8"}
Sep 15 11:38:25.370240 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:25.370204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:25.370487 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:25.370272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:25.370487 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.370431    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:25.370638 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.370494    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret podName:7124cf81-448a-4016-887b-1753ecb7c9cc nodeName:}" failed. No retries permitted until 2026-09-15 11:38:27.370475234 +0000 UTC m=+5.094216904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret") pod "global-pull-secret-syncer-xmpv6" (UID: "7124cf81-448a-4016-887b-1753ecb7c9cc") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:25.371008 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.370881    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:25.371008 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.370934    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs podName:8b4bade6-b906-4b46-a9cc-72134fdfa6c3 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:27.37091923 +0000 UTC m=+5.094660899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs") pod "network-metrics-daemon-9xmv5" (UID: "8b4bade6-b906-4b46-a9cc-72134fdfa6c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:25.470901 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:25.470863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:25.471096 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.471027    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:38:25.471096 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.471051    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:38:25.471096 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.471063    2564 projected.go:196] Error preparing data for projected volume kube-api-access-9zlg8 for pod openshift-network-diagnostics/network-check-target-vvl2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:25.471263 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.471122    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8 podName:8a7c5016-7365-40b4-b9e4-55a553a15b70 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:27.471103009 +0000 UTC m=+5.194844698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zlg8" (UniqueName: "kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8") pod "network-check-target-vvl2s" (UID: "8a7c5016-7365-40b4-b9e4-55a553a15b70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:25.707488 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:25.707445    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:33:24 +0000 UTC" deadline="2028-03-29 03:41:45.551364821 +0000 UTC"
Sep 15 11:38:25.707488 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:25.707488    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13456h3m19.843882369s"
Sep 15 11:38:25.749964 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:25.749929    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:25.750157 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.750138    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:25.750618 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:25.750597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:25.750732 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.750696    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:25.750795 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:25.750778    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:25.750877 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:25.750855    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:26.546747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:26.546389    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:38:27.389046 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:27.388879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:27.389046 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:27.388941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:27.389919 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.389084    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:27.389919 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.389148    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret podName:7124cf81-448a-4016-887b-1753ecb7c9cc nodeName:}" failed. No retries permitted until 2026-09-15 11:38:31.389128466 +0000 UTC m=+9.112870135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret") pod "global-pull-secret-syncer-xmpv6" (UID: "7124cf81-448a-4016-887b-1753ecb7c9cc") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:27.390377 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.390215    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:27.390377 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.390311    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs podName:8b4bade6-b906-4b46-a9cc-72134fdfa6c3 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:31.390292527 +0000 UTC m=+9.114034194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs") pod "network-metrics-daemon-9xmv5" (UID: "8b4bade6-b906-4b46-a9cc-72134fdfa6c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:27.490976 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:27.489899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:27.490976 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.490237    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:38:27.490976 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.490259    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:38:27.490976 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.490291    2564 projected.go:196] Error preparing data for projected volume kube-api-access-9zlg8 for pod openshift-network-diagnostics/network-check-target-vvl2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:27.490976 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.490365    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8 podName:8a7c5016-7365-40b4-b9e4-55a553a15b70 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:31.490336538 +0000 UTC m=+9.214078209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zlg8" (UniqueName: "kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8") pod "network-check-target-vvl2s" (UID: "8a7c5016-7365-40b4-b9e4-55a553a15b70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:27.751086 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:27.750217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:27.751086 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.750389    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:27.751086 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:27.750796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:27.751086 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.750895    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:27.751086 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:27.750959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:27.751086 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:27.751036    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:29.750351 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:29.749668    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:29.750351 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:29.749868    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:29.750351 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:29.750077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:29.750351 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:29.750178    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:29.750351 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:29.750251    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:29.750351 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:29.750343    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:31.425301 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:31.425240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:31.425740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:31.425323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:31.425740 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.425496    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:31.425740 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.425590    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret podName:7124cf81-448a-4016-887b-1753ecb7c9cc nodeName:}" failed. No retries permitted until 2026-09-15 11:38:39.425565768 +0000 UTC m=+17.149307438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret") pod "global-pull-secret-syncer-xmpv6" (UID: "7124cf81-448a-4016-887b-1753ecb7c9cc") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:31.425926 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.425880    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:31.425979 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.425946    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs podName:8b4bade6-b906-4b46-a9cc-72134fdfa6c3 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:39.425927905 +0000 UTC m=+17.149669583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs") pod "network-metrics-daemon-9xmv5" (UID: "8b4bade6-b906-4b46-a9cc-72134fdfa6c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:31.525740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:31.525694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:31.525930 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.525887    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:38:31.525930 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.525914    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:38:31.525930 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.525930    2564 projected.go:196] Error preparing data for projected volume kube-api-access-9zlg8 for pod openshift-network-diagnostics/network-check-target-vvl2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:31.526094 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.525999    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8 podName:8a7c5016-7365-40b4-b9e4-55a553a15b70 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:39.525978532 +0000 UTC m=+17.249720202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zlg8" (UniqueName: "kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8") pod "network-check-target-vvl2s" (UID: "8a7c5016-7365-40b4-b9e4-55a553a15b70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:31.750708 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:31.750033    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:31.750708 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:31.750063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:31.750708 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.750199    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:31.750708 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:31.750477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:31.750708 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.750592    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:31.750708 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:31.750673    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:33.750279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:33.750250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:33.750279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:33.750268    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:33.750671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:33.750261    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:33.750671 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:33.750387    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:33.750671 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:33.750470    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:33.750671 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:33.750539    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:35.750098 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:35.750062    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:35.750570 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:35.750115    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:35.750570 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:35.750174    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:35.750570 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:35.750195    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:35.750570 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:35.750296    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:35.750570 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:35.750375    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:37.750383 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:37.750349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:37.750802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:37.750349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:37.750802 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:37.750467    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:37.750802 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:37.750518    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:37.750802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:37.750349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:37.750802 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:37.750595    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:39.485094 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:39.485062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:39.485094 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:39.485096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:39.485574 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.485177    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:39.485574 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.485201    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:39.485574 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.485235    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret podName:7124cf81-448a-4016-887b-1753ecb7c9cc nodeName:}" failed. No retries permitted until 2026-09-15 11:38:55.485210961 +0000 UTC m=+33.208952625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret") pod "global-pull-secret-syncer-xmpv6" (UID: "7124cf81-448a-4016-887b-1753ecb7c9cc") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:39.485574 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.485263    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs podName:8b4bade6-b906-4b46-a9cc-72134fdfa6c3 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:55.485250107 +0000 UTC m=+33.208991774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs") pod "network-metrics-daemon-9xmv5" (UID: "8b4bade6-b906-4b46-a9cc-72134fdfa6c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:39.585468 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:39.585437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:39.585630 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.585609    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:38:39.585682 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.585639    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:38:39.585682 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.585652    2564 projected.go:196] Error preparing data for projected volume kube-api-access-9zlg8 for pod openshift-network-diagnostics/network-check-target-vvl2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:39.585743 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.585706    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8 podName:8a7c5016-7365-40b4-b9e4-55a553a15b70 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:55.585694302 +0000 UTC m=+33.309435965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zlg8" (UniqueName: "kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8") pod "network-check-target-vvl2s" (UID: "8a7c5016-7365-40b4-b9e4-55a553a15b70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:39.750586 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:39.750509    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:39.750586 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:39.750539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:39.750586 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:39.750539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:39.750827 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.750624    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:39.750827 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.750745    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:39.750914 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:39.750832    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:41.749896 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:41.749854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:41.750358 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:41.749902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:41.750358 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:41.749902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:41.750358 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:41.749981    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:41.750358 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:41.750076    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:41.750358 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:41.750161    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:43.751196 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.749957    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:43.751196 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:43.750489    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:43.751196 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.750917    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:43.751196 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:43.751027    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:43.751196 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.751087    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:43.751196 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:43.751161    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:43.947850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.947820    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24zbk" event={"ID":"4d9fd080-edda-4fe9-8646-8d014cec7f64","Type":"ContainerStarted","Data":"ec4ee3e6dc73577645dfc592ce562a1a5e8f44be82d5c574a3f8216621c6ea21"}
Sep 15 11:38:43.949304 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.949281    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b84f20a-b049-4ff4-b9d5-e436b4095353" containerID="bb4304733bd2ad1118a43ccea41eab95521ec022afb4b4b15c44a7cb26596bd9" exitCode=0
Sep 15 11:38:43.949373 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.949347    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerDied","Data":"bb4304733bd2ad1118a43ccea41eab95521ec022afb4b4b15c44a7cb26596bd9"}
Sep 15 11:38:43.952659 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.952456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"dfddab50e44fb29d9b9b401207a7b2453bcdd63cf2fbc72dfa04a02ac06c5099"}
Sep 15 11:38:43.952659 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.952537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"f1a25c3ab918fe62259e50be283b4378bd485bcd9b3af680366dbaf3f09abffe"}
Sep 15 11:38:43.952659 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.952592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"2cd9854b785ee8a5ec9605fa93ac1603c1b01d28ca040a8e96563e886d57a416"}
Sep 15 11:38:43.952659 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.952639    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"992511423cd789ad660e4c7b04ee3fd83fa1c4761de41fcac0f4e2dda72a1d2f"}
Sep 15 11:38:43.953985 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.953966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal" event={"ID":"7927533a6c5893af59befd4fd5d6b4d6","Type":"ContainerStarted","Data":"7298e9650a50a7bd77ec64777027723303d0deb1a372d7c162b031200ade2553"}
Sep 15 11:38:43.955818 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.955794    2564 generic.go:356] "Generic (PLEG): container finished" podID="6eb5ec72b0d941544dfed6815769df15" containerID="1a9272460796fc48e961adec09d97c5995429178563753f6c6c37f1195dae2b9" exitCode=0
Sep 15 11:38:43.955910 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.955874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal" event={"ID":"6eb5ec72b0d941544dfed6815769df15","Type":"ContainerDied","Data":"1a9272460796fc48e961adec09d97c5995429178563753f6c6c37f1195dae2b9"}
Sep 15 11:38:43.957653 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.957632    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnzpv" event={"ID":"0f78406e-e9af-4add-800b-fc0102ec80fb","Type":"ContainerStarted","Data":"72fdedeab72a15adc8d45111a3dab1c0821ba8368d8bdde4f73a24b5542546e1"}
Sep 15 11:38:43.959413 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.959385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k7tfm" event={"ID":"458502f8-874a-4ba0-92bc-e749f3ad48e5","Type":"ContainerStarted","Data":"4160799f1d4516024903783198b40ede2a4b13e2d5a18ab903a0a96f2670d003"}
Sep 15 11:38:43.961100 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.961081    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7cwd2" event={"ID":"a75f6ca7-de6e-4186-8130-1dd5ce82c1df","Type":"ContainerStarted","Data":"aa803c40af906b37396397c328570238729ad35e5c76d5cf9789dff6dd430177"}
Sep 15 11:38:43.962702 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.962672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r85f8" event={"ID":"1f9b74e0-7785-465e-ac87-49bc6a9693cd","Type":"ContainerStarted","Data":"a2d0448ea475cf28c6ac3bb2d55b08256e31ca7a42ced7bb6ac7796015c22d40"}
Sep 15 11:38:43.964536 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.964518    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n" event={"ID":"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01","Type":"ContainerStarted","Data":"6ad5f42f8d086f7ecaa487af180fc5e50617e9f898b499c4c12a94f03e3a1989"}
Sep 15 11:38:43.972412 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:43.972373    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-24zbk" podStartSLOduration=1.658815251 podStartE2EDuration="20.972359384s" totalImagesPullingTime="19.313544133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:43.972194178 +0000 UTC m=+21.695935861" watchObservedRunningTime="2026-09-15 11:38:43.972359384 +0000 UTC m=+21.696101071"
Sep 15 11:38:44.028640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.028582    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dnzpv" podStartSLOduration=1.741215128 podStartE2EDuration="21.028562104s" totalImagesPullingTime="19.287346976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.002160585 +0000 UTC m=+21.725902270" watchObservedRunningTime="2026-09-15 11:38:44.028562104 +0000 UTC m=+21.752303785"
Sep 15 11:38:44.063761 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.063715    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r85f8" podStartSLOduration=1.700984649 podStartE2EDuration="21.063701193s" totalImagesPullingTime="19.362716544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.063153049 +0000 UTC m=+21.786894735" watchObservedRunningTime="2026-09-15 11:38:44.063701193 +0000 UTC m=+21.787442879"
Sep 15 11:38:44.099422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.099374    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7cwd2" podStartSLOduration=5.654128809 podStartE2EDuration="21.099357384s" totalImagesPullingTime="15.445228575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.099175326 +0000 UTC m=+21.822917016" watchObservedRunningTime="2026-09-15 11:38:44.099357384 +0000 UTC m=+21.823099083"
Sep 15 11:38:44.154231 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.154183    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-13.ec2.internal" podStartSLOduration=20.154168716 podStartE2EDuration="20.154168716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.153933295 +0000 UTC m=+21.877674982" watchObservedRunningTime="2026-09-15 11:38:44.154168716 +0000 UTC m=+21.877910401"
Sep 15 11:38:44.175912 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.175870    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k7tfm" podStartSLOduration=1.774544404 podStartE2EDuration="21.175860342s" totalImagesPullingTime="19.401315938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.175291087 +0000 UTC m=+21.899032773" watchObservedRunningTime="2026-09-15 11:38:44.175860342 +0000 UTC m=+21.899602028"
Sep 15 11:38:44.783072 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.782928    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 11:38:44.969744 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.969710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n" event={"ID":"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01","Type":"ContainerStarted","Data":"859d41cbfca2d3ea54e5d7e74252023150713962b7312c35582e99446d833695"}
Sep 15 11:38:44.972948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.972919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"3fe625020dc9ed12e07feec19f995e392eec40f912332d9b08192ae39a583e45"}
Sep 15 11:38:44.973081 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.973002    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"08a7aea00842b3179e97a9b83367a93e8bb04e8d669806f66cfd2601dcf46e82"}
Sep 15 11:38:44.974601 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.974577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6hmw6" event={"ID":"c57b79c9-b65f-42d1-9658-35ba792b0a1e","Type":"ContainerStarted","Data":"777957bc2666a8e4c7a24b57cf2ebeb3859ca56bbb0ccda202cf4c9d5d9e8a73"}
Sep 15 11:38:44.976502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.976464    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal" event={"ID":"6eb5ec72b0d941544dfed6815769df15","Type":"ContainerStarted","Data":"bf1dce7e4ede4fd33db72213298eea342e9ab6bd282238cf131ec047d163a2f5"}
Sep 15 11:38:44.993771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:44.993730    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6hmw6" podStartSLOduration=6.516341917 podStartE2EDuration="21.993713454s" totalImagesPullingTime="15.477371537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.993136027 +0000 UTC m=+22.716877706" watchObservedRunningTime="2026-09-15 11:38:44.993713454 +0000 UTC m=+22.717455142"
Sep 15 11:38:45.702398 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:45.702286    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T11:38:44.783069049Z","UUID":"a11a03d7-e737-4345-8e17-53b7e93d2c5c","Handler":null,"Name":"","Endpoint":""}
Sep 15 11:38:45.704025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:45.704000    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 11:38:45.704139 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:45.704040    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 11:38:45.749671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:45.749644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:45.749671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:45.749661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:45.749836 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:45.749742    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:45.749836 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:45.749808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:45.749943 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:45.749914    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:45.750022 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:45.749997    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:45.982737 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:45.982704    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n" event={"ID":"e9b1898e-f5d5-4fa7-909b-e4c6f0155f01","Type":"ContainerStarted","Data":"df4497746f00f6fb3c28d13e0815419ddd7f5cf136656c54f2a0ef9d67257eb0"}
Sep 15 11:38:46.006272 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:46.006201    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-13.ec2.internal" podStartSLOduration=22.006179358 podStartE2EDuration="22.006179358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:45.011063948 +0000 UTC m=+22.734805634" watchObservedRunningTime="2026-09-15 11:38:46.006179358 +0000 UTC m=+23.729921034"
Sep 15 11:38:46.006949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:46.006913    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjc5n" podStartSLOduration=1.874189221 podStartE2EDuration="23.006902584s" totalImagesPullingTime="21.132713363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:46.006146933 +0000 UTC m=+23.729888619" watchObservedRunningTime="2026-09-15 11:38:46.006902584 +0000 UTC m=+23.730644296"
Sep 15 11:38:46.987754 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:46.987721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"d2936cd4d782268817d3efe6caac1a9eb01689878a8aac6e42ef0d94795539c7"}
Sep 15 11:38:47.749811 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:47.749779    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:47.749811 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:47.749818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:47.750059 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:47.749950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:47.750059 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:47.749943    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:47.750059 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:47.750037    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:47.750201 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:47.750128    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:48.608691 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:48.608668    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:48.609142 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:48.609124    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:48.612404 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:48.612384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:48.612836 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:48.612816    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7cwd2"
Sep 15 11:38:48.994953 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:48.994710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerStarted","Data":"cf43b843d8518639f47a0687b5bdbafd72cee2e37b08e8066f88eba6c1a646f7"}
Sep 15 11:38:48.998606 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:48.998578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" event={"ID":"211172c5-1e71-459d-b57b-7a501cf3f4fb","Type":"ContainerStarted","Data":"a482dab61b30c1bf52b6c100f202bc85be547b4a3f4c9d3dbe4c4e40a8fe952c"}
Sep 15 11:38:49.039506 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:49.039439    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d" podStartSLOduration=6.670584578 podStartE2EDuration="26.03941727s" totalImagesPullingTime="19.368832692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:49.037514484 +0000 UTC m=+26.761256181" watchObservedRunningTime="2026-09-15 11:38:49.03941727 +0000 UTC m=+26.763158959"
Sep 15 11:38:49.750324 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:49.750289    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:49.750820 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:49.750335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:49.750820 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:49.750297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:49.750820 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:49.750420    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:49.750820 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:49.750483    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:49.750820 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:49.750546    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:50.004087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.004004    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b84f20a-b049-4ff4-b9d5-e436b4095353" containerID="cf43b843d8518639f47a0687b5bdbafd72cee2e37b08e8066f88eba6c1a646f7" exitCode=0
Sep 15 11:38:50.004703 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.004659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerDied","Data":"cf43b843d8518639f47a0687b5bdbafd72cee2e37b08e8066f88eba6c1a646f7"}
Sep 15 11:38:50.006264 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.006242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:50.006375 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.006332    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:50.006481 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.006469    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:50.023997 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.023974    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:50.024425 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.024410    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:38:50.703045 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.703015    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvl2s"]
Sep 15 11:38:50.703269 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.703133    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:50.703321 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:50.703280    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:50.704975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.704951    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9xmv5"]
Sep 15 11:38:50.705090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.705052    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:50.705161 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:50.705137    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:50.708037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.708018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xmpv6"]
Sep 15 11:38:50.708132 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:50.708091    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:50.708180 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:50.708163    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:51.749839 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:51.749814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:51.750379 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:51.749908    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:52.011240 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:52.011150    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b84f20a-b049-4ff4-b9d5-e436b4095353" containerID="9af2a70d7aabfd48825c0d5e8269b6eb2314702c0a2015d5600c21cacc00b926" exitCode=0
Sep 15 11:38:52.011386 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:52.011244    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerDied","Data":"9af2a70d7aabfd48825c0d5e8269b6eb2314702c0a2015d5600c21cacc00b926"}
Sep 15 11:38:52.751244 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:52.751029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:52.751636 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:52.751082    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:52.751636 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:52.751353    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:52.751636 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:52.751405    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:53.015834 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:53.015802    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b84f20a-b049-4ff4-b9d5-e436b4095353" containerID="edf09871b0f76e733972aedc972de0c01f5d10b9f968e16e4bcb9bbd1e79b615" exitCode=0
Sep 15 11:38:53.015994 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:53.015874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerDied","Data":"edf09871b0f76e733972aedc972de0c01f5d10b9f968e16e4bcb9bbd1e79b615"}
Sep 15 11:38:53.749884 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:53.749845    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:53.750056 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:53.749963    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:54.750393 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:54.750358    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:54.750796 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:54.750483    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmpv6" podUID="7124cf81-448a-4016-887b-1753ecb7c9cc"
Sep 15 11:38:54.750796 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:54.750504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:54.750796 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:54.750612    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xmv5" podUID="8b4bade6-b906-4b46-a9cc-72134fdfa6c3"
Sep 15 11:38:55.502334 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:55.502298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:55.502334 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:55.502335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:55.502567 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.502454    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:55.502567 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.502511    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs podName:8b4bade6-b906-4b46-a9cc-72134fdfa6c3 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:27.502496735 +0000 UTC m=+65.226238403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs") pod "network-metrics-daemon-9xmv5" (UID: "8b4bade6-b906-4b46-a9cc-72134fdfa6c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:38:55.502567 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.502454    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:55.502567 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.502549    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret podName:7124cf81-448a-4016-887b-1753ecb7c9cc nodeName:}" failed. No retries permitted until 2026-09-15 11:39:27.502538697 +0000 UTC m=+65.226280376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret") pod "global-pull-secret-syncer-xmpv6" (UID: "7124cf81-448a-4016-887b-1753ecb7c9cc") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:38:55.603584 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:55.603547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:55.603763 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.603705    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:38:55.603763 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.603721    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:38:55.603763 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.603730    2564 projected.go:196] Error preparing data for projected volume kube-api-access-9zlg8 for pod openshift-network-diagnostics/network-check-target-vvl2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:55.603914 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.603780    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8 podName:8a7c5016-7365-40b4-b9e4-55a553a15b70 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:27.603768075 +0000 UTC m=+65.327509751 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zlg8" (UniqueName: "kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8") pod "network-check-target-vvl2s" (UID: "8a7c5016-7365-40b4-b9e4-55a553a15b70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:38:55.749954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:55.749920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:55.750142 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:55.750039    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvl2s" podUID="8a7c5016-7365-40b4-b9e4-55a553a15b70"
Sep 15 11:38:56.105358 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.105327    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-13.ec2.internal" event="NodeReady"
Sep 15 11:38:56.105828 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.105458    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 11:38:56.145116 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.145080    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9bbdcc78c-tl4z9"]
Sep 15 11:38:56.157686 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.157663    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4rpcz"]
Sep 15 11:38:56.157842 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.157808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.160427 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.160286    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 11:38:56.160427 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.160352    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 11:38:56.160610 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.160284    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 11:38:56.160610 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.160284    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gswmg\""
Sep 15 11:38:56.168884 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.168751    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ln95b"]
Sep 15 11:38:56.169315 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.169280    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 11:38:56.171871 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.169867    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.173316 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.173293    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hx5hb\""
Sep 15 11:38:56.174422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.174248    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 11:38:56.174422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.174283    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 11:38:56.184084 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.184065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9bbdcc78c-tl4z9"]
Sep 15 11:38:56.184185 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.184100    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ln95b"]
Sep 15 11:38:56.184263 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.184185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ln95b"
Sep 15 11:38:56.184263 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.184208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4rpcz"]
Sep 15 11:38:56.186493 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.186474    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 11:38:56.186592 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.186582    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vqwj6\""
Sep 15 11:38:56.186662 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.186545    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 11:38:56.186721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.186550    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 11:38:56.308319 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.308319 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-bound-sa-token\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.308540 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-image-registry-private-configuration\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.308540 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jpgp\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-kube-api-access-6jpgp\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.308540 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkb88\" (UniqueName: \"kubernetes.io/projected/d2a7e706-4087-4419-aad4-d9e6a02ebcfc-kube-api-access-hkb88\") pod \"ingress-canary-ln95b\" (UID: \"d2a7e706-4087-4419-aad4-d9e6a02ebcfc\") " pod="openshift-ingress-canary/ingress-canary-ln95b"
Sep 15 11:38:56.308540 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e8f995-53c0-429b-be84-96856f74e688-tmp-dir\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.308747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07e8f995-53c0-429b-be84-96856f74e688-config-volume\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.308747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-installation-pull-secrets\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.308747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2a7e706-4087-4419-aad4-d9e6a02ebcfc-cert\") pod \"ingress-canary-ln95b\" (UID: \"d2a7e706-4087-4419-aad4-d9e6a02ebcfc\") " pod="openshift-ingress-canary/ingress-canary-ln95b"
Sep 15 11:38:56.308747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-certificates\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.308747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-trusted-ca\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.308937 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.308937 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lkgt\" (UniqueName: \"kubernetes.io/projected/07e8f995-53c0-429b-be84-96856f74e688-kube-api-access-7lkgt\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.308937 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.308830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/665aa985-95ba-4c08-a6f5-92bce7c4d488-ca-trust-extracted\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.409572 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.409740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-bound-sa-token\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.409740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-image-registry-private-configuration\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.409740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jpgp\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-kube-api-access-6jpgp\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.409740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkb88\" (UniqueName: \"kubernetes.io/projected/d2a7e706-4087-4419-aad4-d9e6a02ebcfc-kube-api-access-hkb88\") pod \"ingress-canary-ln95b\" (UID: \"d2a7e706-4087-4419-aad4-d9e6a02ebcfc\") " pod="openshift-ingress-canary/ingress-canary-ln95b"
Sep 15 11:38:56.409740 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.409688    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:38:56.409740 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.409712    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9bbdcc78c-tl4z9: secret "image-registry-tls" not found
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.409775    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls podName:665aa985-95ba-4c08-a6f5-92bce7c4d488 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:56.909754767 +0000 UTC m=+34.633496445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls") pod "image-registry-9bbdcc78c-tl4z9" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488") : secret "image-registry-tls" not found
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e8f995-53c0-429b-be84-96856f74e688-tmp-dir\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07e8f995-53c0-429b-be84-96856f74e688-config-volume\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409878    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-installation-pull-secrets\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2a7e706-4087-4419-aad4-d9e6a02ebcfc-cert\") pod \"ingress-canary-ln95b\" (UID: \"d2a7e706-4087-4419-aad4-d9e6a02ebcfc\") " pod="openshift-ingress-canary/ingress-canary-ln95b"
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-certificates\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.409954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-trusted-ca\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.410009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.410032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.410029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lkgt\" (UniqueName: \"kubernetes.io/projected/07e8f995-53c0-429b-be84-96856f74e688-kube-api-access-7lkgt\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.410471 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.410048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/665aa985-95ba-4c08-a6f5-92bce7c4d488-ca-trust-extracted\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.410471 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.410077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e8f995-53c0-429b-be84-96856f74e688-tmp-dir\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.410471 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.410149    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:38:56.410471 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.410187    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls podName:07e8f995-53c0-429b-be84-96856f74e688 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:56.910174292 +0000 UTC m=+34.633915981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls") pod "dns-default-4rpcz" (UID: "07e8f995-53c0-429b-be84-96856f74e688") : secret "dns-default-metrics-tls" not found
Sep 15 11:38:56.410471 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.410339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/665aa985-95ba-4c08-a6f5-92bce7c4d488-ca-trust-extracted\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.410704 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.410507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07e8f995-53c0-429b-be84-96856f74e688-config-volume\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.410901 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.410878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-certificates\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.410987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.410967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-trusted-ca\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.414350 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.414328    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-image-registry-private-configuration\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.414350 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.414337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-installation-pull-secrets\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.414517 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.414350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2a7e706-4087-4419-aad4-d9e6a02ebcfc-cert\") pod \"ingress-canary-ln95b\" (UID: \"d2a7e706-4087-4419-aad4-d9e6a02ebcfc\") " pod="openshift-ingress-canary/ingress-canary-ln95b"
Sep 15 11:38:56.418327 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.418302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-bound-sa-token\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.418519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.418494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jpgp\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-kube-api-access-6jpgp\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.418831 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.418812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkb88\" (UniqueName: \"kubernetes.io/projected/d2a7e706-4087-4419-aad4-d9e6a02ebcfc-kube-api-access-hkb88\") pod \"ingress-canary-ln95b\" (UID: \"d2a7e706-4087-4419-aad4-d9e6a02ebcfc\") " pod="openshift-ingress-canary/ingress-canary-ln95b"
Sep 15 11:38:56.419709 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.419692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lkgt\" (UniqueName: \"kubernetes.io/projected/07e8f995-53c0-429b-be84-96856f74e688-kube-api-access-7lkgt\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.490804 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.490767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.493504 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.493478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ln95b"
Sep 15 11:38:56.578050 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.577974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.679097 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.679062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.741925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.741891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:56.749905 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.749884    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:38:56.750054 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.750042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:38:56.752606 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.752585    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:38:56.752717 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.752650    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:38:56.753636 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.753619    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dmnh2\""
Sep 15 11:38:56.914892 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.914787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:56.914892 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:56.914838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:56.915104 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.914958    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:38:56.915104 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.914973    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9bbdcc78c-tl4z9: secret "image-registry-tls" not found
Sep 15 11:38:56.915104 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.914982    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:38:56.915104 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.915055    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls podName:07e8f995-53c0-429b-be84-96856f74e688 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:57.915035657 +0000 UTC m=+35.638777335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls") pod "dns-default-4rpcz" (UID: "07e8f995-53c0-429b-be84-96856f74e688") : secret "dns-default-metrics-tls" not found
Sep 15 11:38:56.915104 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:56.915073    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls podName:665aa985-95ba-4c08-a6f5-92bce7c4d488 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:57.915063769 +0000 UTC m=+35.638805437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls") pod "image-registry-9bbdcc78c-tl4z9" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488") : secret "image-registry-tls" not found
Sep 15 11:38:57.539406 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.539248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:57.609707 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.609679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:57.723234 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.723153    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ln95b"]
Sep 15 11:38:57.750446 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.750420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:38:57.752862 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.752847    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:38:57.753696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.753680    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:38:57.753762 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.753705    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bwddj\""
Sep 15 11:38:57.767380 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:38:57.767361    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a7e706_4087_4419_aad4_d9e6a02ebcfc.slice/crio-3c8ce97426ccc045a84155529fc4fbb0113d3e79abb52ac4161f8829964b1e53 WatchSource:0}: Error finding container 3c8ce97426ccc045a84155529fc4fbb0113d3e79abb52ac4161f8829964b1e53: Status 404 returned error can't find the container with id 3c8ce97426ccc045a84155529fc4fbb0113d3e79abb52ac4161f8829964b1e53
Sep 15 11:38:57.923802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.923776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:57.923904 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:57.923810    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:57.923944 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:57.923925    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:38:57.923990 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:57.923980    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls podName:07e8f995-53c0-429b-be84-96856f74e688 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:59.923963561 +0000 UTC m=+37.647705228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls") pod "dns-default-4rpcz" (UID: "07e8f995-53c0-429b-be84-96856f74e688") : secret "dns-default-metrics-tls" not found
Sep 15 11:38:57.924038 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:57.923929    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:38:57.924038 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:57.924006    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9bbdcc78c-tl4z9: secret "image-registry-tls" not found
Sep 15 11:38:57.924038 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:57.924037    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls podName:665aa985-95ba-4c08-a6f5-92bce7c4d488 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:59.924027787 +0000 UTC m=+37.647769465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls") pod "image-registry-9bbdcc78c-tl4z9" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488") : secret "image-registry-tls" not found
Sep 15 11:38:58.028943 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:58.028917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ln95b" event={"ID":"d2a7e706-4087-4419-aad4-d9e6a02ebcfc","Type":"ContainerStarted","Data":"3c8ce97426ccc045a84155529fc4fbb0113d3e79abb52ac4161f8829964b1e53"}
Sep 15 11:38:58.035205 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:58.035168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerStarted","Data":"d3c702ac52f4c6b5d7ccd946ee243d99ed4e2529ee20057c99a9bb3b31cc5ac6"}
Sep 15 11:38:59.041036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:59.040999    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b84f20a-b049-4ff4-b9d5-e436b4095353" containerID="d3c702ac52f4c6b5d7ccd946ee243d99ed4e2529ee20057c99a9bb3b31cc5ac6" exitCode=0
Sep 15 11:38:59.041533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:59.041073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerDied","Data":"d3c702ac52f4c6b5d7ccd946ee243d99ed4e2529ee20057c99a9bb3b31cc5ac6"}
Sep 15 11:38:59.075060 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:59.075029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:59.942292 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:59.942250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:38:59.942476 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:38:59.942308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:38:59.942476 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:59.942395    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:38:59.942476 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:59.942428    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:38:59.942476 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:59.942453    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9bbdcc78c-tl4z9: secret "image-registry-tls" not found
Sep 15 11:38:59.942476 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:59.942475    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls podName:07e8f995-53c0-429b-be84-96856f74e688 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:03.942455868 +0000 UTC m=+41.666197536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls") pod "dns-default-4rpcz" (UID: "07e8f995-53c0-429b-be84-96856f74e688") : secret "dns-default-metrics-tls" not found
Sep 15 11:38:59.942699 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:38:59.942507    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls podName:665aa985-95ba-4c08-a6f5-92bce7c4d488 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:03.942491651 +0000 UTC m=+41.666233336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls") pod "image-registry-9bbdcc78c-tl4z9" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488") : secret "image-registry-tls" not found
Sep 15 11:39:00.047430 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:00.047394    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b84f20a-b049-4ff4-b9d5-e436b4095353" containerID="84d91fede1ee1e42b508c362f1e39e453612ff29d2ef5db8e47a3a1727460072" exitCode=0
Sep 15 11:39:00.047998 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:00.047480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerDied","Data":"84d91fede1ee1e42b508c362f1e39e453612ff29d2ef5db8e47a3a1727460072"}
Sep 15 11:39:01.053712 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:01.053490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52wmm" event={"ID":"4b84f20a-b049-4ff4-b9d5-e436b4095353","Type":"ContainerStarted","Data":"7ee87a315cb2ac5b2bf17f784e2a865efe613da77562dc44b29825f3a2987b7c"}
Sep 15 11:39:01.054823 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:01.054803    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ln95b" event={"ID":"d2a7e706-4087-4419-aad4-d9e6a02ebcfc","Type":"ContainerStarted","Data":"225af233d7a2b0efc7a398755964347a467c4e6bb319b9cc78384b0eab2ec4fb"}
Sep 15 11:39:01.093077 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:01.093031    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ln95b" podStartSLOduration=2.3987965989999998 podStartE2EDuration="5.093016577s" totalImagesPullingTime="2.694219978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:01.092282416 +0000 UTC m=+38.816024101" watchObservedRunningTime="2026-09-15 11:39:01.093016577 +0000 UTC m=+38.816758326"
Sep 15 11:39:01.093334 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:01.093313    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-52wmm" podStartSLOduration=7.425784307 podStartE2EDuration="38.093307696s" totalImagesPullingTime="30.667523389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:01.077104417 +0000 UTC m=+38.800846115" watchObservedRunningTime="2026-09-15 11:39:01.093307696 +0000 UTC m=+38.817049382"
Sep 15 11:39:01.207424 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:01.207391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.308275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:01.308193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.661190 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:01.661159    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:01.763306 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:01.763274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:03.971702 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:03.971668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:39:03.971702 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:03.971705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:39:03.972081 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:03.971821    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:39:03.972081 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:03.971892    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls podName:07e8f995-53c0-429b-be84-96856f74e688 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:11.971878317 +0000 UTC m=+49.695619985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls") pod "dns-default-4rpcz" (UID: "07e8f995-53c0-429b-be84-96856f74e688") : secret "dns-default-metrics-tls" not found
Sep 15 11:39:03.972081 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:03.971823    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:39:03.972081 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:03.971922    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9bbdcc78c-tl4z9: secret "image-registry-tls" not found
Sep 15 11:39:03.972081 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:03.971961    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls podName:665aa985-95ba-4c08-a6f5-92bce7c4d488 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:11.971950615 +0000 UTC m=+49.695692293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls") pod "image-registry-9bbdcc78c-tl4z9" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488") : secret "image-registry-tls" not found
Sep 15 11:39:09.193175 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:09.193138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:09.262306 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:09.262271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:10.548945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:10.548895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:10.682427 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:10.682386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:11.305881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:11.305821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:11.374477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:11.374448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:12.024836 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:12.024805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:39:12.025290 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:12.024841    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:39:12.025290 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:12.024957    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:39:12.025290 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:12.024972    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9bbdcc78c-tl4z9: secret "image-registry-tls" not found
Sep 15 11:39:12.025290 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:12.024972    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:39:12.025290 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:12.025045    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls podName:665aa985-95ba-4c08-a6f5-92bce7c4d488 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:28.025026241 +0000 UTC m=+65.748767906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls") pod "image-registry-9bbdcc78c-tl4z9" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488") : secret "image-registry-tls" not found
Sep 15 11:39:12.025290 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:12.025063    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls podName:07e8f995-53c0-429b-be84-96856f74e688 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:28.025054982 +0000 UTC m=+65.748796663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls") pod "dns-default-4rpcz" (UID: "07e8f995-53c0-429b-be84-96856f74e688") : secret "dns-default-metrics-tls" not found
Sep 15 11:39:12.592750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:12.592717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:12.655181 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:12.655145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:16.916565 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:16.916529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:16.979496 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:16.979461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:22.021592 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:22.021566    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhh4d"
Sep 15 11:39:22.180378 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:22.180349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:22.255494 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:22.255453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:27.528685 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.528647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:39:27.528685 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.528688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:39:27.531210 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.531189    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:39:27.531319 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.531235    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:39:27.539311 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:27.539290    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 11:39:27.539414 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:27.539352    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs podName:8b4bade6-b906-4b46-a9cc-72134fdfa6c3 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:31.539330876 +0000 UTC m=+129.263072540 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs") pod "network-metrics-daemon-9xmv5" (UID: "8b4bade6-b906-4b46-a9cc-72134fdfa6c3") : secret "metrics-daemon-secret" not found
Sep 15 11:39:27.542824 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.542806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7124cf81-448a-4016-887b-1753ecb7c9cc-original-pull-secret\") pod \"global-pull-secret-syncer-xmpv6\" (UID: \"7124cf81-448a-4016-887b-1753ecb7c9cc\") " pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:39:27.629580 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.629541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:39:27.632167 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.632150    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:39:27.642111 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.642089    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:39:27.653215 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.653192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zlg8\" (UniqueName: \"kubernetes.io/projected/8a7c5016-7365-40b4-b9e4-55a553a15b70-kube-api-access-9zlg8\") pod \"network-check-target-vvl2s\" (UID: \"8a7c5016-7365-40b4-b9e4-55a553a15b70\") " pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:39:27.666125 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.666110    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmpv6"
Sep 15 11:39:27.762212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.762184    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bwddj\""
Sep 15 11:39:27.770250 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.770231    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:39:27.970111 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:27.970081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xmpv6"]
Sep 15 11:39:27.972994 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:39:27.972968    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7124cf81_448a_4016_887b_1753ecb7c9cc.slice/crio-2fa9c6cecd13e7834691e7193a37a4c6f0de6f741123c102dce3321a0ce853c9 WatchSource:0}: Error finding container 2fa9c6cecd13e7834691e7193a37a4c6f0de6f741123c102dce3321a0ce853c9: Status 404 returned error can't find the container with id 2fa9c6cecd13e7834691e7193a37a4c6f0de6f741123c102dce3321a0ce853c9
Sep 15 11:39:28.032989 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:28.032958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:39:28.033168 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:28.032994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:39:28.033168 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:28.033115    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 11:39:28.033264 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:28.033176    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls podName:07e8f995-53c0-429b-be84-96856f74e688 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:00.033160866 +0000 UTC m=+97.756902530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls") pod "dns-default-4rpcz" (UID: "07e8f995-53c0-429b-be84-96856f74e688") : secret "dns-default-metrics-tls" not found
Sep 15 11:39:28.033264 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:28.033116    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 11:39:28.033264 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:28.033213    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9bbdcc78c-tl4z9: secret "image-registry-tls" not found
Sep 15 11:39:28.033398 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:28.033276    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls podName:665aa985-95ba-4c08-a6f5-92bce7c4d488 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:00.033262064 +0000 UTC m=+97.757003728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls") pod "image-registry-9bbdcc78c-tl4z9" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488") : secret "image-registry-tls" not found
Sep 15 11:39:28.058917 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:28.058854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvl2s"]
Sep 15 11:39:28.061857 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:39:28.061832    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7c5016_7365_40b4_b9e4_55a553a15b70.slice/crio-e2c34912ce82af9f6ecdae5cbbf735a0d3454c7dca8ba7585739faab5adfe9a3 WatchSource:0}: Error finding container e2c34912ce82af9f6ecdae5cbbf735a0d3454c7dca8ba7585739faab5adfe9a3: Status 404 returned error can't find the container with id e2c34912ce82af9f6ecdae5cbbf735a0d3454c7dca8ba7585739faab5adfe9a3
Sep 15 11:39:28.113580 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:28.113548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xmpv6" event={"ID":"7124cf81-448a-4016-887b-1753ecb7c9cc","Type":"ContainerStarted","Data":"2fa9c6cecd13e7834691e7193a37a4c6f0de6f741123c102dce3321a0ce853c9"}
Sep 15 11:39:28.114530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:28.114507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvl2s" event={"ID":"8a7c5016-7365-40b4-b9e4-55a553a15b70","Type":"ContainerStarted","Data":"e2c34912ce82af9f6ecdae5cbbf735a0d3454c7dca8ba7585739faab5adfe9a3"}
Sep 15 11:39:32.157014 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.156980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.163744 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.163714    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr"]
Sep 15 11:39:32.165665 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.165645    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr"
Sep 15 11:39:32.168057 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.168033    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vwgq9\""
Sep 15 11:39:32.168320 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.168300    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:39:32.169004 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.168985    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 11:39:32.177933 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.177916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr"]
Sep 15 11:39:32.252236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.252193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.265055 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.265024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx64d\" (UniqueName: \"kubernetes.io/projected/09a3958d-a066-4fb6-bba9-c672ffc0e734-kube-api-access-sx64d\") pod \"volume-data-source-validator-86695b7cc7-gsjjr\" (UID: \"09a3958d-a066-4fb6-bba9-c672ffc0e734\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr"
Sep 15 11:39:32.267452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.267429    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c9c6b8bf6-9cgkq"]
Sep 15 11:39:32.269264 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.269246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.272937 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.272921    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 11:39:32.273146 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.273127    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 15 11:39:32.273230 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.273199    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 11:39:32.273291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.273271    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8jpqf\""
Sep 15 11:39:32.273556 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.273536    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 15 11:39:32.273763 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.273744    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 15 11:39:32.273998 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.273984    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 15 11:39:32.285406 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.285354    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c9c6b8bf6-9cgkq"]
Sep 15 11:39:32.365482 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.365451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx64d\" (UniqueName: \"kubernetes.io/projected/09a3958d-a066-4fb6-bba9-c672ffc0e734-kube-api-access-sx64d\") pod \"volume-data-source-validator-86695b7cc7-gsjjr\" (UID: \"09a3958d-a066-4fb6-bba9-c672ffc0e734\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr"
Sep 15 11:39:32.376380 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.376352    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx64d\" (UniqueName: \"kubernetes.io/projected/09a3958d-a066-4fb6-bba9-c672ffc0e734-kube-api-access-sx64d\") pod \"volume-data-source-validator-86695b7cc7-gsjjr\" (UID: \"09a3958d-a066-4fb6-bba9-c672ffc0e734\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr"
Sep 15 11:39:32.466143 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.466063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-stats-auth\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.466231 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.466169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.466231 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.466202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-default-certificate\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.466340 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.466250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2576\" (UniqueName: \"kubernetes.io/projected/0456757c-bbf2-4121-833a-8a3e3c44891f-kube-api-access-x2576\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.466340 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.466283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.467864 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.467805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.475963 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.475947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr"
Sep 15 11:39:32.568058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.567553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.568058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.567585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-default-certificate\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.568058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.567602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2576\" (UniqueName: \"kubernetes.io/projected/0456757c-bbf2-4121-833a-8a3e3c44891f-kube-api-access-x2576\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.568058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.567672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.568058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.567746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-stats-auth\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.568058 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:32.567898    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:33.067883115 +0000 UTC m=+70.791624779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : configmap references non-existent config key: service-ca.crt
Sep 15 11:39:32.568473 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:32.568120    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 11:39:32.568473 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:32.568176    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:33.06816082 +0000 UTC m=+70.791902483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : secret "router-metrics-certs-default" not found
Sep 15 11:39:32.569175 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.569147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:32.570554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.570536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-default-certificate\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.571082 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.571067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-stats-auth\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.577696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.576460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2576\" (UniqueName: \"kubernetes.io/projected/0456757c-bbf2-4121-833a-8a3e3c44891f-kube-api-access-x2576\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:32.740621 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:32.740594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr"]
Sep 15 11:39:32.743363 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:39:32.743330    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a3958d_a066_4fb6_bba9_c672ffc0e734.slice/crio-e3f7faf81a00d0f04d12d68512adc9076624a5130a8cb42c16f5def03c7b9051 WatchSource:0}: Error finding container e3f7faf81a00d0f04d12d68512adc9076624a5130a8cb42c16f5def03c7b9051: Status 404 returned error can't find the container with id e3f7faf81a00d0f04d12d68512adc9076624a5130a8cb42c16f5def03c7b9051
Sep 15 11:39:33.071236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.071121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:33.071236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.071179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:33.071236 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:33.071237    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 11:39:33.071451 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:33.071301    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:34.071285992 +0000 UTC m=+71.795027656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : secret "router-metrics-certs-default" not found
Sep 15 11:39:33.071451 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:33.071316    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:34.071309924 +0000 UTC m=+71.795051589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : configmap references non-existent config key: service-ca.crt
Sep 15 11:39:33.129669 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.129634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr" event={"ID":"09a3958d-a066-4fb6-bba9-c672ffc0e734","Type":"ContainerStarted","Data":"e3f7faf81a00d0f04d12d68512adc9076624a5130a8cb42c16f5def03c7b9051"}
Sep 15 11:39:33.131037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.131013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvl2s" event={"ID":"8a7c5016-7365-40b4-b9e4-55a553a15b70","Type":"ContainerStarted","Data":"70bae0afda74776bab63031c36c2e1c01c4533bef5c46c4934e1963018a2f7e0"}
Sep 15 11:39:33.131158 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.131089    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:39:33.132446 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.132425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xmpv6" event={"ID":"7124cf81-448a-4016-887b-1753ecb7c9cc","Type":"ContainerStarted","Data":"36b60b380f0fc837c18e076cbaaeb73b0518e3729011d244a0825645397a6394"}
Sep 15 11:39:33.147609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.147544    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vvl2s" podStartSLOduration=65.804194461 podStartE2EDuration="1m10.147529609s" totalImagesPullingTime="4.343335148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:33.147190124 +0000 UTC m=+70.870931813" watchObservedRunningTime="2026-09-15 11:39:33.147529609 +0000 UTC m=+70.871271297"
Sep 15 11:39:33.163309 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.163265    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xmpv6" podStartSLOduration=65.725204007 podStartE2EDuration="1m10.163254827s" totalImagesPullingTime="4.43805082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:33.162558414 +0000 UTC m=+70.886300102" watchObservedRunningTime="2026-09-15 11:39:33.163254827 +0000 UTC m=+70.886996514"
Sep 15 11:39:33.521582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.521551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:33.583703 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:33.583670    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:34.079124 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:34.079093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:34.079315 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:34.079205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:34.079315 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:34.079207    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 11:39:34.079315 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:34.079286    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:36.079269901 +0000 UTC m=+73.803011568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : secret "router-metrics-certs-default" not found
Sep 15 11:39:34.079462 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:34.079364    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:36.079346306 +0000 UTC m=+73.803087990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : configmap references non-existent config key: service-ca.crt
Sep 15 11:39:34.136779 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:34.136702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr" event={"ID":"09a3958d-a066-4fb6-bba9-c672ffc0e734","Type":"ContainerStarted","Data":"c23b9d9a7eb45f0af9e4b74d49e81470614fab8c891e1af82295ae2bf8eb551f"}
Sep 15 11:39:34.152277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:34.152212    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gsjjr" podStartSLOduration=1.01025327 podStartE2EDuration="2.152197574s" totalImagesPullingTime="1.141944304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:34.151814589 +0000 UTC m=+71.875556267" watchObservedRunningTime="2026-09-15 11:39:34.152197574 +0000 UTC m=+71.875939260"
Sep 15 11:39:34.243466 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:34.243439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:34.302683 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:34.302655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:35.998530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:35.998497    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j7bgz"]
Sep 15 11:39:36.001980 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.001946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:36.002134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.002118    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.004400 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.004381    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 11:39:36.004509 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.004384    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 11:39:36.005487 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.005466    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 11:39:36.005847 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.005830    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-68t74\""
Sep 15 11:39:36.006204 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.006188    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 11:39:36.013980 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.013960    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j7bgz"]
Sep 15 11:39:36.081167 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.081137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:36.094450 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.094426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:36.094565 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.094459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.094565 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.094477    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.094565 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.094492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fzc\" (UniqueName: \"kubernetes.io/projected/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-api-access-n8fzc\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.094565 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.094513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:36.094717 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.094565    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 11:39:36.094717 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.094623    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:40.094605327 +0000 UTC m=+77.818347007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : secret "router-metrics-certs-default" not found
Sep 15 11:39:36.094717 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.094652    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:40.094640518 +0000 UTC m=+77.818382182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : configmap references non-existent config key: service-ca.crt
Sep 15 11:39:36.094717 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.094702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/429e71b6-6eba-49e5-ae0b-011fad0a1912-crio-socket\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.094872 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.094734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/429e71b6-6eba-49e5-ae0b-011fad0a1912-data-volume\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.195031 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.195002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.195031 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.195028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.195274 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.195045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fzc\" (UniqueName: \"kubernetes.io/projected/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-api-access-n8fzc\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.195274 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.195100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/429e71b6-6eba-49e5-ae0b-011fad0a1912-crio-socket\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.195274 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.195115    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:39:36.195274 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.195123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/429e71b6-6eba-49e5-ae0b-011fad0a1912-data-volume\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.195274 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.195145    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:36.195274 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.195180    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:36.695163155 +0000 UTC m=+74.418904838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : configmap "kube-rbac-proxy" not found
Sep 15 11:39:36.195274 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.195198    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:36.69518906 +0000 UTC m=+74.418930732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:36.195274 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.195258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/429e71b6-6eba-49e5-ae0b-011fad0a1912-crio-socket\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.195552 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.195459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/429e71b6-6eba-49e5-ae0b-011fad0a1912-data-volume\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.204838 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.204823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fzc\" (UniqueName: \"kubernetes.io/projected/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-api-access-n8fzc\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.366032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.365970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:36.435989 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.435957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:36.698977 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.698948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.699155 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:36.698986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:36.699155 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.699059    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:39:36.699155 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.699126    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:37.699111738 +0000 UTC m=+75.422853405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : configmap "kube-rbac-proxy" not found
Sep 15 11:39:36.699155 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.699140    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:36.699366 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:36.699202    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:37.699186044 +0000 UTC m=+75.422927708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:37.486771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:37.486735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:37.704329 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:37.704297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:37.704329 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:37.704331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:37.704539 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:37.704411    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:39:37.704539 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:37.704471    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:39.704456793 +0000 UTC m=+77.428198472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : configmap "kube-rbac-proxy" not found
Sep 15 11:39:37.704539 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:37.704471    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:37.704539 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:37.704498    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:39.704492231 +0000 UTC m=+77.428233895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:37.957743 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:37.957719    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnzpv_0f78406e-e9af-4add-800b-fc0102ec80fb/dns-node-resolver/0.log"
Sep 15 11:39:37.971558 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:37.971537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.061417 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:38.061396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.410049 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:38.409958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.475741 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:38.475711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.853919 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:38.853890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.953785 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:38.953752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:39.054970 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:39.054939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:39.155698 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:39.155623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:39.159882 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:39.159865    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r85f8_1f9b74e0-7785-465e-ac87-49bc6a9693cd/node-ca/0.log"
Sep 15 11:39:39.225037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:39.225011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:39.717323 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:39.717285    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:39.717486 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:39.717391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:39.717486 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:39.717429    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:39.717486 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:39.717448    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:39:39.717584 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:39.717494    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:43.717478462 +0000 UTC m=+81.441220127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:39.717584 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:39.717509    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:43.717503236 +0000 UTC m=+81.441244900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : configmap "kube-rbac-proxy" not found
Sep 15 11:39:39.758214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:39.758192    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ln95b_d2a7e706-4087-4419-aad4-d9e6a02ebcfc/serve-healthcheck-canary/0.log"
Sep 15 11:39:40.120678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:40.120596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:40.120678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:40.120645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:40.121055 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:40.120744    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 11:39:40.121055 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:40.120752    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:48.120739039 +0000 UTC m=+85.844480702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : configmap references non-existent config key: service-ca.crt
Sep 15 11:39:40.121055 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:40.120803    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:39:48.120790196 +0000 UTC m=+85.844531861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : secret "router-metrics-certs-default" not found
Sep 15 11:39:40.759795 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:40.759758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:40.829486 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:40.829439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:41.650657 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:41.650617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:43.561047 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:43.561016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:43.740595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:43.740561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:43.740595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:43.740595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:43.740788 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:43.740672    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 11:39:43.740788 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:43.740695    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:43.740788 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:43.740731    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:51.740716259 +0000 UTC m=+89.464457923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : configmap "kube-rbac-proxy" not found
Sep 15 11:39:43.740788 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:43.740746    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:51.740738621 +0000 UTC m=+89.464480284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:43.810716 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:43.810687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:43.916174 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:43.916090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:44.012020 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:44.011980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:44.113534 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:44.113503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:44.263294 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:44.263262    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:44.454511 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:44.454487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:45.264298 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:45.264143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:45.659595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:45.659508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:45.861764 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:45.861731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:46.057554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:46.057525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:46.259380 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:46.259343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:47.255897 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:47.255866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:47.356874 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:47.356826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:47.457025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:47.456993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:47.867799 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:47.867760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:48.005207 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:48.005173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:48.085556 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:48.085524    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:48.151080 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:48.151009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:48.171541 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:48.171516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:48.171650 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:48.171561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:39:48.171699 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:48.171659    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 11:39:48.171699 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:48.171690    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:40:04.171677344 +0000 UTC m=+101.895419008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : configmap references non-existent config key: service-ca.crt
Sep 15 11:39:48.171783 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:48.171710    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs podName:0456757c-bbf2-4121-833a-8a3e3c44891f nodeName:}" failed. No retries permitted until 2026-09-15 11:40:04.171697453 +0000 UTC m=+101.895439117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs") pod "router-default-6c9c6b8bf6-9cgkq" (UID: "0456757c-bbf2-4121-833a-8a3e3c44891f") : secret "router-metrics-certs-default" not found
Sep 15 11:39:48.467198 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:48.467163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:49.054485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:49.054452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:49.188123 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:49.188086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:49.465503 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:49.465473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:49.823110 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:49.823019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:49.888489 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:49.888453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:50.263684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:50.263646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:50.656765 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:50.656677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:50.859808 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:50.859776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:51.266944 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:51.266907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:51.799714 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:51.799661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:51.799714 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:51.799710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:51.799932 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:51.799838    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:51.799932 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:39:51.799905    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls podName:429e71b6-6eba-49e5-ae0b-011fad0a1912 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:07.799890324 +0000 UTC m=+105.523632010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j7bgz" (UID: "429e71b6-6eba-49e5-ae0b-011fad0a1912") : secret "insights-runtime-extractor-tls" not found
Sep 15 11:39:51.800205 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:51.800184    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/429e71b6-6eba-49e5-ae0b-011fad0a1912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:39:51.857725 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:51.857688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:52.264875 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:52.264836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:52.465873 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:52.465836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:52.851124 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:52.851081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:53.663521 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:53.663494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:53.852252 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:53.852205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:54.056638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:54.056603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:54.254281 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:54.254251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:57.544462 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:57.544429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:57.612236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:39:57.612186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:00.060335 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.060287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:40:00.060720 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.060340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:40:00.062482 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.062453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07e8f995-53c0-429b-be84-96856f74e688-metrics-tls\") pod \"dns-default-4rpcz\" (UID: \"07e8f995-53c0-429b-be84-96856f74e688\") " pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:40:00.062637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.062618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"image-registry-9bbdcc78c-tl4z9\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") " pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:40:00.074060 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.074043    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gswmg\""
Sep 15 11:40:00.081999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.081981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:40:00.084424 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.084409    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hx5hb\""
Sep 15 11:40:00.092419 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.092400    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:40:00.357681 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.357599    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9bbdcc78c-tl4z9"]
Sep 15 11:40:00.361711 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:00.361677    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665aa985_95ba_4c08_a6f5_92bce7c4d488.slice/crio-cd1b4b4ecf9121533283af788b763d60def91ef5b705490ba9c57758d824ec38 WatchSource:0}: Error finding container cd1b4b4ecf9121533283af788b763d60def91ef5b705490ba9c57758d824ec38: Status 404 returned error can't find the container with id cd1b4b4ecf9121533283af788b763d60def91ef5b705490ba9c57758d824ec38
Sep 15 11:40:00.371490 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:00.371467    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4rpcz"]
Sep 15 11:40:00.374799 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:00.374774    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e8f995_53c0_429b_be84_96856f74e688.slice/crio-6011343c4f91b3266531f3f1f282f25d73d68d0c5ebcd8121a25702bc646457a WatchSource:0}: Error finding container 6011343c4f91b3266531f3f1f282f25d73d68d0c5ebcd8121a25702bc646457a: Status 404 returned error can't find the container with id 6011343c4f91b3266531f3f1f282f25d73d68d0c5ebcd8121a25702bc646457a
Sep 15 11:40:01.202177 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:01.202130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9" event={"ID":"665aa985-95ba-4c08-a6f5-92bce7c4d488","Type":"ContainerStarted","Data":"a720bf6f94c34616039ebc3f8ec51c522375fbbca7f666af6ed2e04faa96e71a"}
Sep 15 11:40:01.202638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:01.202194    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9" event={"ID":"665aa985-95ba-4c08-a6f5-92bce7c4d488","Type":"ContainerStarted","Data":"cd1b4b4ecf9121533283af788b763d60def91ef5b705490ba9c57758d824ec38"}
Sep 15 11:40:01.202638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:01.202240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:40:01.203600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:01.203571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4rpcz" event={"ID":"07e8f995-53c0-429b-be84-96856f74e688","Type":"ContainerStarted","Data":"6011343c4f91b3266531f3f1f282f25d73d68d0c5ebcd8121a25702bc646457a"}
Sep 15 11:40:01.223900 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:01.223847    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9" podStartSLOduration=98.223833146 podStartE2EDuration="1m38.223833146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:01.222440324 +0000 UTC m=+98.946182013" watchObservedRunningTime="2026-09-15 11:40:01.223833146 +0000 UTC m=+98.947574832"
Sep 15 11:40:02.208491 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:02.208457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4rpcz" event={"ID":"07e8f995-53c0-429b-be84-96856f74e688","Type":"ContainerStarted","Data":"971efdf8da91ed5a4cade4d98e4401d27bcfb6190012ebebd03194cdcbc0b435"}
Sep 15 11:40:02.208819 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:02.208543    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4rpcz" event={"ID":"07e8f995-53c0-429b-be84-96856f74e688","Type":"ContainerStarted","Data":"b07e9c6701f2b140acff7642068a86521660f6bea4a1637c434cf5113151054c"}
Sep 15 11:40:02.226951 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:02.226902    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4rpcz" podStartSLOduration=64.60927055 podStartE2EDuration="1m6.226886688s" totalImagesPullingTime="1.617616138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:02.22579932 +0000 UTC m=+99.949541007" watchObservedRunningTime="2026-09-15 11:40:02.226886688 +0000 UTC m=+99.950628374"
Sep 15 11:40:03.195951 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:03.195921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:03.212832 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:03.212801    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:40:03.294173 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:03.294138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:04.138870 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:04.138840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vvl2s"
Sep 15 11:40:04.191889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:04.191857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:04.192040 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:04.191907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:04.192487 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:04.192464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0456757c-bbf2-4121-833a-8a3e3c44891f-service-ca-bundle\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:04.194712 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:04.194694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0456757c-bbf2-4121-833a-8a3e3c44891f-metrics-certs\") pod \"router-default-6c9c6b8bf6-9cgkq\" (UID: \"0456757c-bbf2-4121-833a-8a3e3c44891f\") " pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:04.380182 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:04.380140    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:04.651133 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:04.651060    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c9c6b8bf6-9cgkq"]
Sep 15 11:40:04.654156 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:04.654128    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0456757c_bbf2_4121_833a_8a3e3c44891f.slice/crio-936c95524db1989cb00315d611000a42d2cafd92ce2814c758a203fef613a277 WatchSource:0}: Error finding container 936c95524db1989cb00315d611000a42d2cafd92ce2814c758a203fef613a277: Status 404 returned error can't find the container with id 936c95524db1989cb00315d611000a42d2cafd92ce2814c758a203fef613a277
Sep 15 11:40:05.220620 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:05.220585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq" event={"ID":"0456757c-bbf2-4121-833a-8a3e3c44891f","Type":"ContainerStarted","Data":"697b802dcc39ca4a0a13e6ad5ff5d2d3a21fc108823465ab21fd3ef8a3fd3685"}
Sep 15 11:40:05.220797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:05.220633    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq" event={"ID":"0456757c-bbf2-4121-833a-8a3e3c44891f","Type":"ContainerStarted","Data":"936c95524db1989cb00315d611000a42d2cafd92ce2814c758a203fef613a277"}
Sep 15 11:40:05.241349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:05.241301    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq" podStartSLOduration=33.241284218 podStartE2EDuration="33.241284218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:05.239991273 +0000 UTC m=+102.963732960" watchObservedRunningTime="2026-09-15 11:40:05.241284218 +0000 UTC m=+102.965025904"
Sep 15 11:40:05.380931 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:05.380898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:05.382205 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:05.382169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:05.383605 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:05.383588    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:05.453178 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:05.453145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:06.223201 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:06.223174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:06.224411 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:06.224388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c9c6b8bf6-9cgkq"
Sep 15 11:40:07.160154 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.160117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.260614 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.260582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.331850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.331817    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"]
Sep 15 11:40:07.332015 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.331937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.365508 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.365481    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"]
Sep 15 11:40:07.365636 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.365568    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"
Sep 15 11:40:07.368302 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.368284    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rln6d\""
Sep 15 11:40:07.368407 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.368299    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 11:40:07.417970 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.417912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-sxr8s\" (UID: \"3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"
Sep 15 11:40:07.518958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.518912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-sxr8s\" (UID: \"3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"
Sep 15 11:40:07.519089 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:07.519033    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 11:40:07.519089 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:07.519088    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583-tls-certificates podName:3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:08.019073227 +0000 UTC m=+105.742814891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-sxr8s" (UID: "3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 11:40:07.599878 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.599833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:07.821726 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.821684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:40:07.823952 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:07.823927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/429e71b6-6eba-49e5-ae0b-011fad0a1912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7bgz\" (UID: \"429e71b6-6eba-49e5-ae0b-011fad0a1912\") " pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:40:08.023446 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:08.023404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-sxr8s\" (UID: \"3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"
Sep 15 11:40:08.025652 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:08.025630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-sxr8s\" (UID: \"3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"
Sep 15 11:40:08.114909 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:08.114840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j7bgz"
Sep 15 11:40:08.274321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:08.274290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"
Sep 15 11:40:08.396932 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:08.396907    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j7bgz"]
Sep 15 11:40:08.399328 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:08.399303    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429e71b6_6eba_49e5_ae0b_011fad0a1912.slice/crio-835f68b4cae354bc62d554c185782f854d8fd0dd651e34e669a87ae7a88da1f0 WatchSource:0}: Error finding container 835f68b4cae354bc62d554c185782f854d8fd0dd651e34e669a87ae7a88da1f0: Status 404 returned error can't find the container with id 835f68b4cae354bc62d554c185782f854d8fd0dd651e34e669a87ae7a88da1f0
Sep 15 11:40:08.563174 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:08.563130    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"]
Sep 15 11:40:08.567822 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:08.567801    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e25cd7c_0eb7_4a3a_beb8_0dce1b27c583.slice/crio-b2e626f4557983b2b63674149a0a3ab36448e24296201f54f70a5d63c44082d5 WatchSource:0}: Error finding container b2e626f4557983b2b63674149a0a3ab36448e24296201f54f70a5d63c44082d5: Status 404 returned error can't find the container with id b2e626f4557983b2b63674149a0a3ab36448e24296201f54f70a5d63c44082d5
Sep 15 11:40:09.237534 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:09.237502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7bgz" event={"ID":"429e71b6-6eba-49e5-ae0b-011fad0a1912","Type":"ContainerStarted","Data":"0ac0aefaaa207ab97a61b0ee245a572e85844937852ef064b04dcd7848e44103"}
Sep 15 11:40:09.237624 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:09.237573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7bgz" event={"ID":"429e71b6-6eba-49e5-ae0b-011fad0a1912","Type":"ContainerStarted","Data":"835f68b4cae354bc62d554c185782f854d8fd0dd651e34e669a87ae7a88da1f0"}
Sep 15 11:40:09.238835 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:09.238808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s" event={"ID":"3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583","Type":"ContainerStarted","Data":"b2e626f4557983b2b63674149a0a3ab36448e24296201f54f70a5d63c44082d5"}
Sep 15 11:40:10.244753 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.244713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7bgz" event={"ID":"429e71b6-6eba-49e5-ae0b-011fad0a1912","Type":"ContainerStarted","Data":"7c3c501e0bf3d6ba93e7706bb2a83f56f917674233b9985c0c1e61555a9539fa"}
Sep 15 11:40:10.246414 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.246385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s" event={"ID":"3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583","Type":"ContainerStarted","Data":"e99fe767d6410c9d94ae43ccc57dd8ee10b9e49556ecf489acd8e75529746979"}
Sep 15 11:40:10.246631 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.246612    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"
Sep 15 11:40:10.252131 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.252110    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s"
Sep 15 11:40:10.264737 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.264684    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-sxr8s" podStartSLOduration=2.174291292 podStartE2EDuration="3.264672649s" totalImagesPullingTime="1.090381357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:10.263532458 +0000 UTC m=+107.987274138" watchObservedRunningTime="2026-09-15 11:40:10.264672649 +0000 UTC m=+107.988414336"
Sep 15 11:40:10.367936 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.367896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:10.402323 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.402287    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"]
Sep 15 11:40:10.404680 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.404656    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.407023 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.407002    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 11:40:10.407317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.407285    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 15 11:40:10.407317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.407293    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ztk95\""
Sep 15 11:40:10.407491 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.407335    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 11:40:10.407491 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.407369    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 11:40:10.407491 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.407414    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 15 11:40:10.415045 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.415017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"]
Sep 15 11:40:10.436069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.436041    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:10.439917 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.439891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74k5s\" (UniqueName: \"kubernetes.io/projected/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-kube-api-access-74k5s\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.440036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.439926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.440036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.439952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.440036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.440003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.541278 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.541194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74k5s\" (UniqueName: \"kubernetes.io/projected/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-kube-api-access-74k5s\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.541278 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.541244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.541278 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.541268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.541541 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.541311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.541541 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:10.541422    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 15 11:40:10.541541 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:10.541486    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-tls podName:e36a572b-4cc6-4bd4-85f3-1866e8320bf6 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:11.041466719 +0000 UTC m=+108.765208400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-bmd9g" (UID: "e36a572b-4cc6-4bd4-85f3-1866e8320bf6") : secret "prometheus-operator-tls" not found
Sep 15 11:40:10.541997 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.541968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.544032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.544007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.550782 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.550757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74k5s\" (UniqueName: \"kubernetes.io/projected/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-kube-api-access-74k5s\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:10.758133 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:10.758112    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:11.044807 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:11.044706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:11.047076 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:11.047052    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e36a572b-4cc6-4bd4-85f3-1866e8320bf6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-bmd9g\" (UID: \"e36a572b-4cc6-4bd4-85f3-1866e8320bf6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:11.251393 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:11.251360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7bgz" event={"ID":"429e71b6-6eba-49e5-ae0b-011fad0a1912","Type":"ContainerStarted","Data":"e63c8906e50990495ab0e2ec6ee21eddf6a17c0d857f60e91a3243ea680299a5"}
Sep 15 11:40:11.271123 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:11.271078    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j7bgz" podStartSLOduration=34.185472876 podStartE2EDuration="36.271064049s" totalImagesPullingTime="2.085591173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:39:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:11.270635821 +0000 UTC m=+108.994377506" watchObservedRunningTime="2026-09-15 11:40:11.271064049 +0000 UTC m=+108.994805735"
Sep 15 11:40:11.315550 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:11.315484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"
Sep 15 11:40:11.582258 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:11.582170    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g"]
Sep 15 11:40:11.584850 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:11.584819    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36a572b_4cc6_4bd4_85f3_1866e8320bf6.slice/crio-de47480dad30984647798de82e687382e452d6b468814e32d6ad297bdc7a8322 WatchSource:0}: Error finding container de47480dad30984647798de82e687382e452d6b468814e32d6ad297bdc7a8322: Status 404 returned error can't find the container with id de47480dad30984647798de82e687382e452d6b468814e32d6ad297bdc7a8322
Sep 15 11:40:12.255832 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:12.255800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g" event={"ID":"e36a572b-4cc6-4bd4-85f3-1866e8320bf6","Type":"ContainerStarted","Data":"de47480dad30984647798de82e687382e452d6b468814e32d6ad297bdc7a8322"}
Sep 15 11:40:13.218727 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:13.218695    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4rpcz"
Sep 15 11:40:13.263043 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:13.262947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g" event={"ID":"e36a572b-4cc6-4bd4-85f3-1866e8320bf6","Type":"ContainerStarted","Data":"fb22edddb44f4d0e82a8ce821f300c1a2c60c6df8f80d977ca546859bcbf4846"}
Sep 15 11:40:13.263043 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:13.263008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g" event={"ID":"e36a572b-4cc6-4bd4-85f3-1866e8320bf6","Type":"ContainerStarted","Data":"2d575f32d2adeea7d8105accce3f873ce1931aab0c530dde6c944f16aafa1788"}
Sep 15 11:40:13.283345 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:13.283288    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-bmd9g" podStartSLOduration=1.719267441 podStartE2EDuration="3.283269342s" totalImagesPullingTime="1.564001901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:13.2823729 +0000 UTC m=+111.006114587" watchObservedRunningTime="2026-09-15 11:40:13.283269342 +0000 UTC m=+111.007011028"
Sep 15 11:40:13.412735 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:13.412663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.494893 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.494852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.626568 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.626531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.731972 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.731941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.743961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.743932    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"]
Sep 15 11:40:14.747033 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.746996    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.749408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.749388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x75pv\""
Sep 15 11:40:14.749533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.749414    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 15 11:40:14.749533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.749427    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 15 11:40:14.759382 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.759359    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"]
Sep 15 11:40:14.768350 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.768328    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"]
Sep 15 11:40:14.773401 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.773377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.775557 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.775522    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 15 11:40:14.775669 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.775522    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 15 11:40:14.775669 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.775557    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 15 11:40:14.775855 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.775841    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zvtf7\""
Sep 15 11:40:14.780348 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.780328    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9wlft"]
Sep 15 11:40:14.783488 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.783469    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.783975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.783957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"]
Sep 15 11:40:14.785473 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.785453    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bk6sw\""
Sep 15 11:40:14.785600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.785583    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 11:40:14.785719 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.785703    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 11:40:14.785756 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.785742    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 11:40:14.829468 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.829436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.872636 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.872636 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872641    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2508c3-4396-4a8b-9144-31cc2ea284e6-metrics-client-ca\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.872865 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.872865 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fsdx\" (UniqueName: \"kubernetes.io/projected/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-kube-api-access-4fsdx\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.872865 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-tls\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.872865 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrvnl\" (UniqueName: \"kubernetes.io/projected/ba2508c3-4396-4a8b-9144-31cc2ea284e6-kube-api-access-lrvnl\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.873025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.873025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-sys\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.873025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.873025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.873025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.872963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-wtmp\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.873025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.873013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.873295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.873068    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpjs5\" (UniqueName: \"kubernetes.io/projected/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-api-access-kpjs5\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.873295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.873085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.873295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.873101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-root\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.873295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.873116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.873295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.873161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-textfile\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.873295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.873275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.873295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.873293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.938816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.938062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:14.973674 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.973644    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2508c3-4396-4a8b-9144-31cc2ea284e6-metrics-client-ca\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.973852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.973681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.973852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.973711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fsdx\" (UniqueName: \"kubernetes.io/projected/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-kube-api-access-4fsdx\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.973852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.973735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-tls\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.973852 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:14.973828    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 11:40:14.974076 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:14.973893    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-tls podName:ba2508c3-4396-4a8b-9144-31cc2ea284e6 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:15.473872978 +0000 UTC m=+113.197614641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-tls") pod "node-exporter-9wlft" (UID: "ba2508c3-4396-4a8b-9144-31cc2ea284e6") : secret "node-exporter-tls" not found
Sep 15 11:40:14.974153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrvnl\" (UniqueName: \"kubernetes.io/projected/ba2508c3-4396-4a8b-9144-31cc2ea284e6-kube-api-access-lrvnl\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.974153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.974291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-sys\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.974291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.974291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.974291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-wtmp\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.974510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.974510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpjs5\" (UniqueName: \"kubernetes.io/projected/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-api-access-kpjs5\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.974510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.974510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-root\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.974510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.974510 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:14.974442    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 15 11:40:14.974510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-textfile\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.974510 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:14.974490    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-tls podName:dbac6a1f-9a04-47cf-bde4-81dfd389d0b0 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:15.47447402 +0000 UTC m=+113.198215685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-mmpbc" (UID: "dbac6a1f-9a04-47cf-bde4-81dfd389d0b0") : secret "openshift-state-metrics-tls" not found
Sep 15 11:40:14.974925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.974925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.974925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.974925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba2508c3-4396-4a8b-9144-31cc2ea284e6-metrics-client-ca\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.974925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974722    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-textfile\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.974925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.974793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-wtmp\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.975250 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.975045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-sys\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.975250 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.975155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.975408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.975335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.975408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.975386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.975516 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.975414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba2508c3-4396-4a8b-9144-31cc2ea284e6-root\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.976096 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.976072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.976420 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.976362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.977806 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.977779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.977910 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.977888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.977961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.977945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.978004 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.977982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:14.984362 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.984342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fsdx\" (UniqueName: \"kubernetes.io/projected/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-kube-api-access-4fsdx\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:14.984928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.984911    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrvnl\" (UniqueName: \"kubernetes.io/projected/ba2508c3-4396-4a8b-9144-31cc2ea284e6-kube-api-access-lrvnl\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:14.985330 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:14.985312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpjs5\" (UniqueName: \"kubernetes.io/projected/f16b7e3e-ea4f-4ace-879a-c043e305f4d1-kube-api-access-kpjs5\") pod \"kube-state-metrics-59fbdd77d-p7gkm\" (UID: \"f16b7e3e-ea4f-4ace-879a-c043e305f4d1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:15.037707 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.037591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:15.082320 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.082277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"
Sep 15 11:40:15.137756 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.137705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:15.237579 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.237545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:15.337689 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.337615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:15.351948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.351924    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm"]
Sep 15 11:40:15.354720 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:15.354695    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16b7e3e_ea4f_4ace_879a_c043e305f4d1.slice/crio-6ebf7ca3ad6327a579c4e96a36f77a4b43cecc9c1bf270970337c108a32bcdc0 WatchSource:0}: Error finding container 6ebf7ca3ad6327a579c4e96a36f77a4b43cecc9c1bf270970337c108a32bcdc0: Status 404 returned error can't find the container with id 6ebf7ca3ad6327a579c4e96a36f77a4b43cecc9c1bf270970337c108a32bcdc0
Sep 15 11:40:15.478621 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.478585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-tls\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:15.478787 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.478653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:15.480953 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.480922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba2508c3-4396-4a8b-9144-31cc2ea284e6-node-exporter-tls\") pod \"node-exporter-9wlft\" (UID: \"ba2508c3-4396-4a8b-9144-31cc2ea284e6\") " pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:15.481056 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.480975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbac6a1f-9a04-47cf-bde4-81dfd389d0b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-mmpbc\" (UID: \"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:15.656666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.656565    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"
Sep 15 11:40:15.692503 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.692458    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9wlft"
Sep 15 11:40:15.708840 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:15.708802    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2508c3_4396_4a8b_9144_31cc2ea284e6.slice/crio-d2524f17480a77cbd6305e67ded8d693de47cfbb522c3c09098f30da7b105a20 WatchSource:0}: Error finding container d2524f17480a77cbd6305e67ded8d693de47cfbb522c3c09098f30da7b105a20: Status 404 returned error can't find the container with id d2524f17480a77cbd6305e67ded8d693de47cfbb522c3c09098f30da7b105a20
Sep 15 11:40:15.746866 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.746822    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:15.816920 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.816890    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:40:15.818815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.818785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:15.821373 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.821353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824448    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824467    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824499    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824537    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824448    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824459    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824459    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824581    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 11:40:15.824690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824669    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 11:40:15.825049 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.824721    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9kp48\""
Sep 15 11:40:15.834331 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.834311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:40:15.882418 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882418 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8248\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-kube-api-access-k8248\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-config-volume\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882942 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882942 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-config-out\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882942 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-web-config\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.882942 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.882766    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.932267 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.932243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc"]
Sep 15 11:40:15.934288 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:15.934262    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbac6a1f_9a04_47cf_bde4_81dfd389d0b0.slice/crio-9790a22373e3f543a9c56503b90d77d53c76d1da78a5c54da1543fe18265a917 WatchSource:0}: Error finding container 9790a22373e3f543a9c56503b90d77d53c76d1da78a5c54da1543fe18265a917: Status 404 returned error can't find the container with id 9790a22373e3f543a9c56503b90d77d53c76d1da78a5c54da1543fe18265a917
Sep 15 11:40:15.983115 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8248\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-kube-api-access-k8248\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-config-volume\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-config-out\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-web-config\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.983538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.985039 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.983913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.985039 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:15.984499    2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 15 11:40:15.985039 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:40:15.984559    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls podName:6399541b-10c1-484d-abe6-b61d938b2f08 nodeName:}" failed. No retries permitted until 2026-09-15 11:40:16.484540902 +0000 UTC m=+114.208282578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08") : secret "alertmanager-main-tls" not found
Sep 15 11:40:15.985039 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.984755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.985785 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.985175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.986111 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.986090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-config-out\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.986533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.986509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.986697 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.986668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-config-volume\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.987104 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.987086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.987193 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.987117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.988099 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.988078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.988556 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.988536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.989413 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.989310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-web-config\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:15.991118 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:15.991096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8248\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-kube-api-access-k8248\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:16.053746 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.053697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:16.274088 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.274049    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc" event={"ID":"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0","Type":"ContainerStarted","Data":"008c9d115d43493dfa53ec03325ef2330e69a8197cad9cc7bb7f3547bfcd311a"}
Sep 15 11:40:16.274295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.274152    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc" event={"ID":"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0","Type":"ContainerStarted","Data":"e63130f55be25dd211f944d8d4d27d2ddce4d6919628c5834aa11b2fad0a2032"}
Sep 15 11:40:16.274295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.274175    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc" event={"ID":"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0","Type":"ContainerStarted","Data":"9790a22373e3f543a9c56503b90d77d53c76d1da78a5c54da1543fe18265a917"}
Sep 15 11:40:16.275126 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.275105    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wlft" event={"ID":"ba2508c3-4396-4a8b-9144-31cc2ea284e6","Type":"ContainerStarted","Data":"d2524f17480a77cbd6305e67ded8d693de47cfbb522c3c09098f30da7b105a20"}
Sep 15 11:40:16.276124 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.276107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm" event={"ID":"f16b7e3e-ea4f-4ace-879a-c043e305f4d1","Type":"ContainerStarted","Data":"6ebf7ca3ad6327a579c4e96a36f77a4b43cecc9c1bf270970337c108a32bcdc0"}
Sep 15 11:40:16.488137 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.488090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:16.491011 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.490977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:16.731870 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.731835    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:40:16.756416 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.756389    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b4f87946-8rwsh"]
Sep 15 11:40:16.760444 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.760422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.762959 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.762934    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 15 11:40:16.763066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.762984    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 15 11:40:16.763282 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.763265    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-69vagjc3ne5uq\""
Sep 15 11:40:16.763353 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.763317    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 15 11:40:16.763455 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.763265    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z2ngk\""
Sep 15 11:40:16.763517 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.763502    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 15 11:40:16.763597 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.763449    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 15 11:40:16.766327 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.766306    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b4f87946-8rwsh"]
Sep 15 11:40:16.892606 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.892568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-tls\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.892813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.892624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67tpr\" (UniqueName: \"kubernetes.io/projected/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-kube-api-access-67tpr\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.892813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.892696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.892813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.892789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.892960 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.892860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-grpc-tls\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.892960 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.892888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.892960 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.892920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-metrics-client-ca\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.893084 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.892960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.993469 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.993386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.993469 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.993446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.993684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.993477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-grpc-tls\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.993684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.993502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.993684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.993532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-metrics-client-ca\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.993684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.993568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.993684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.993601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-tls\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.993684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.993632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67tpr\" (UniqueName: \"kubernetes.io/projected/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-kube-api-access-67tpr\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.994739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.994683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-metrics-client-ca\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.996531 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.996479    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.996531 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.996502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.996759 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.996730    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.997066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.997043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.997537 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.997515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-thanos-querier-tls\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:16.997630 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:16.997612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-secret-grpc-tls\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:17.007678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:17.007656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67tpr\" (UniqueName: \"kubernetes.io/projected/28c9f38a-73b8-4a68-bf70-ba11a40a38ac-kube-api-access-67tpr\") pod \"thanos-querier-5b4f87946-8rwsh\" (UID: \"28c9f38a-73b8-4a68-bf70-ba11a40a38ac\") " pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:17.072688 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:17.072645    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:17.684111 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:17.684077    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b4f87946-8rwsh"]
Sep 15 11:40:17.692014 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:17.688246    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:40:17.696441 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:17.696408    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6399541b_10c1_484d_abe6_b61d938b2f08.slice/crio-c73a932d4d85e6c5c835dda2dd6c7f1d34d17d2be0de32c8523a5256b045acf7 WatchSource:0}: Error finding container c73a932d4d85e6c5c835dda2dd6c7f1d34d17d2be0de32c8523a5256b045acf7: Status 404 returned error can't find the container with id c73a932d4d85e6c5c835dda2dd6c7f1d34d17d2be0de32c8523a5256b045acf7
Sep 15 11:40:17.750055 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:17.750021    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:17.849888 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:17.849849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:18.043640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.043608    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-rzfhv"]
Sep 15 11:40:18.047889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.047871    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-rzfhv"
Sep 15 11:40:18.050790 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.050767    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 11:40:18.050959 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.050941    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 11:40:18.051010 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.050983    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kd9zs\""
Sep 15 11:40:18.069327 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.069298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:18.098349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.098325    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-rzfhv"]
Sep 15 11:40:18.103249 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.103209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82kh\" (UniqueName: \"kubernetes.io/projected/9566d059-9587-4aa4-914a-41bc092ad17f-kube-api-access-k82kh\") pod \"downloads-76f99584f4-rzfhv\" (UID: \"9566d059-9587-4aa4-914a-41bc092ad17f\") " pod="openshift-console/downloads-76f99584f4-rzfhv"
Sep 15 11:40:18.204435 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.204403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82kh\" (UniqueName: \"kubernetes.io/projected/9566d059-9587-4aa4-914a-41bc092ad17f-kube-api-access-k82kh\") pod \"downloads-76f99584f4-rzfhv\" (UID: \"9566d059-9587-4aa4-914a-41bc092ad17f\") " pod="openshift-console/downloads-76f99584f4-rzfhv"
Sep 15 11:40:18.213514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.213489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82kh\" (UniqueName: \"kubernetes.io/projected/9566d059-9587-4aa4-914a-41bc092ad17f-kube-api-access-k82kh\") pod \"downloads-76f99584f4-rzfhv\" (UID: \"9566d059-9587-4aa4-914a-41bc092ad17f\") " pod="openshift-console/downloads-76f99584f4-rzfhv"
Sep 15 11:40:18.286977 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.286940    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba2508c3-4396-4a8b-9144-31cc2ea284e6" containerID="2eb24fce6b556adb29dce075273b7285d76853521e9b354a7e25fc5f6173e3d6" exitCode=0
Sep 15 11:40:18.287150 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.287022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wlft" event={"ID":"ba2508c3-4396-4a8b-9144-31cc2ea284e6","Type":"ContainerDied","Data":"2eb24fce6b556adb29dce075273b7285d76853521e9b354a7e25fc5f6173e3d6"}
Sep 15 11:40:18.290006 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.289974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm" event={"ID":"f16b7e3e-ea4f-4ace-879a-c043e305f4d1","Type":"ContainerStarted","Data":"0c143b5b323b5b24536f952b65edddbc690ea6f2920688ff988ede21963fcfad"}
Sep 15 11:40:18.290159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.290125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm" event={"ID":"f16b7e3e-ea4f-4ace-879a-c043e305f4d1","Type":"ContainerStarted","Data":"521ecc9f351f68f1a7316dc5357e89f67de4d12d97db2b99c33964666f65626f"}
Sep 15 11:40:18.290294 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.290163    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm" event={"ID":"f16b7e3e-ea4f-4ace-879a-c043e305f4d1","Type":"ContainerStarted","Data":"462a95843bf9001212aba26db9a9d878f75fd73a2853a0579375b7a6d47d2937"}
Sep 15 11:40:18.291433 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.291370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerStarted","Data":"c73a932d4d85e6c5c835dda2dd6c7f1d34d17d2be0de32c8523a5256b045acf7"}
Sep 15 11:40:18.294094 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.294041    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc" event={"ID":"dbac6a1f-9a04-47cf-bde4-81dfd389d0b0","Type":"ContainerStarted","Data":"32df86ef958305a3dc5eff01078a7e4861f9fd8db64f9b30340740c7279622b0"}
Sep 15 11:40:18.295338 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.295319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh" event={"ID":"28c9f38a-73b8-4a68-bf70-ba11a40a38ac","Type":"ContainerStarted","Data":"73d69ed7e10d30421d7cbd327a1402987fbf20b68d1ea6d419187c2d9aee0dea"}
Sep 15 11:40:18.329522 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.329475    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-mmpbc" podStartSLOduration=2.988138351 podStartE2EDuration="4.329457935s" totalImagesPullingTime="1.341319584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:18.327968605 +0000 UTC m=+116.051710302" watchObservedRunningTime="2026-09-15 11:40:18.329457935 +0000 UTC m=+116.053199620"
Sep 15 11:40:18.332938 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.332840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:18.349354 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.349297    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-p7gkm" podStartSLOduration=2.301657196 podStartE2EDuration="4.349275065s" totalImagesPullingTime="2.047617869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:18.348676421 +0000 UTC m=+116.072418110" watchObservedRunningTime="2026-09-15 11:40:18.349275065 +0000 UTC m=+116.073016754"
Sep 15 11:40:18.356886 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.356864    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-rzfhv"
Sep 15 11:40:18.415035 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.415005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:18.637503 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.637417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-rzfhv"]
Sep 15 11:40:18.643281 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:18.643183    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9566d059_9587_4aa4_914a_41bc092ad17f.slice/crio-5f07b2fe75829012085112b31c21c8e49cc8328154bb565d53d358a700f9ba8b WatchSource:0}: Error finding container 5f07b2fe75829012085112b31c21c8e49cc8328154bb565d53d358a700f9ba8b: Status 404 returned error can't find the container with id 5f07b2fe75829012085112b31c21c8e49cc8328154bb565d53d358a700f9ba8b
Sep 15 11:40:18.717633 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.717548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:18.818797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:18.818768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:19.073619 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.073560    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-bfbcd57f6-v787l"]
Sep 15 11:40:19.077582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.077556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.082954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.082842    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 15 11:40:19.082954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.082902    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rc7pj\""
Sep 15 11:40:19.083171 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.083115    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cs9m1o29q10dg\""
Sep 15 11:40:19.083254 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.082842    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 15 11:40:19.083357 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.083337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 15 11:40:19.083462 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.083384    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 15 11:40:19.088453 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.088389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bfbcd57f6-v787l"]
Sep 15 11:40:19.123803 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.123771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:19.196576 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.196537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:19.213253 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.213212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/664c0e09-c5a4-46b1-887b-226fa7d63366-audit-log\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.213359 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.213293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-client-ca-bundle\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.213359 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.213329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-secret-metrics-server-tls\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.213486 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.213426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9g9h\" (UniqueName: \"kubernetes.io/projected/664c0e09-c5a4-46b1-887b-226fa7d63366-kube-api-access-q9g9h\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.213486 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.213451    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/664c0e09-c5a4-46b1-887b-226fa7d63366-metrics-server-audit-profiles\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.213587 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.213489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/664c0e09-c5a4-46b1-887b-226fa7d63366-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.213587 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.213543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-secret-metrics-server-client-certs\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.301288 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.301256    2564 generic.go:356] "Generic (PLEG): container finished" podID="6399541b-10c1-484d-abe6-b61d938b2f08" containerID="4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1" exitCode=0
Sep 15 11:40:19.301459 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.301348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerDied","Data":"4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1"}
Sep 15 11:40:19.302793 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.302765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-rzfhv" event={"ID":"9566d059-9587-4aa4-914a-41bc092ad17f","Type":"ContainerStarted","Data":"5f07b2fe75829012085112b31c21c8e49cc8328154bb565d53d358a700f9ba8b"}
Sep 15 11:40:19.305661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.305594    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wlft" event={"ID":"ba2508c3-4396-4a8b-9144-31cc2ea284e6","Type":"ContainerStarted","Data":"f7aca51abbb558120678b59b20d95336603cd175b86678296f8409ed2e2d081a"}
Sep 15 11:40:19.305661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.305652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wlft" event={"ID":"ba2508c3-4396-4a8b-9144-31cc2ea284e6","Type":"ContainerStarted","Data":"005cf029765a29919667f7fe2e6ed8c53a399c097ec82295d5dbd4ad25b67fff"}
Sep 15 11:40:19.314498 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.314462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-secret-metrics-server-client-certs\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.314649 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.314537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/664c0e09-c5a4-46b1-887b-226fa7d63366-audit-log\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.314649 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.314579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-client-ca-bundle\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.314649 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.314614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-secret-metrics-server-tls\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.314871 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.314683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9g9h\" (UniqueName: \"kubernetes.io/projected/664c0e09-c5a4-46b1-887b-226fa7d63366-kube-api-access-q9g9h\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.314871 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.314710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/664c0e09-c5a4-46b1-887b-226fa7d63366-metrics-server-audit-profiles\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.314871 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.314744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/664c0e09-c5a4-46b1-887b-226fa7d63366-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.315811 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.315586    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/664c0e09-c5a4-46b1-887b-226fa7d63366-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.317008 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.316892    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/664c0e09-c5a4-46b1-887b-226fa7d63366-metrics-server-audit-profiles\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.317173 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.317153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/664c0e09-c5a4-46b1-887b-226fa7d63366-audit-log\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.320249 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.318051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-secret-metrics-server-tls\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.320249 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.318202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-secret-metrics-server-client-certs\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.321851 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.321829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/664c0e09-c5a4-46b1-887b-226fa7d63366-client-ca-bundle\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.323929 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.323878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9g9h\" (UniqueName: \"kubernetes.io/projected/664c0e09-c5a4-46b1-887b-226fa7d63366-kube-api-access-q9g9h\") pod \"metrics-server-bfbcd57f6-v787l\" (UID: \"664c0e09-c5a4-46b1-887b-226fa7d63366\") " pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.351961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.351914    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9wlft" podStartSLOduration=3.58119314 podStartE2EDuration="5.351898013s" totalImagesPullingTime="1.692602421s" totalInitContainerRuntime="78.102452ms" isStatefulPod=true podCreationTimestamp="2026-09-15 11:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:19.350361154 +0000 UTC m=+117.074102867" watchObservedRunningTime="2026-09-15 11:40:19.351898013 +0000 UTC m=+117.075639700"
Sep 15 11:40:19.391668 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.391638    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:19.520382 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.520349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:19.525964 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.525931    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"]
Sep 15 11:40:19.529771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.529747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:19.532823 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.532357    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 11:40:19.532823 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.532432    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mgvft\""
Sep 15 11:40:19.538713 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.537676    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"]
Sep 15 11:40:19.619358 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.619271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc6v6\" (UniqueName: \"kubernetes.io/projected/cf64d983-9da3-4030-9cb0-64e8d1f924eb-kube-api-access-nc6v6\") pod \"monitoring-plugin-5d85778b9d-d46cg\" (UID: \"cf64d983-9da3-4030-9cb0-64e8d1f924eb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:19.619525 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.619383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf64d983-9da3-4030-9cb0-64e8d1f924eb-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d46cg\" (UID: \"cf64d983-9da3-4030-9cb0-64e8d1f924eb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:19.621684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.621654    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:19.720188 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.720096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc6v6\" (UniqueName: \"kubernetes.io/projected/cf64d983-9da3-4030-9cb0-64e8d1f924eb-kube-api-access-nc6v6\") pod \"monitoring-plugin-5d85778b9d-d46cg\" (UID: \"cf64d983-9da3-4030-9cb0-64e8d1f924eb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:19.720515 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.720207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf64d983-9da3-4030-9cb0-64e8d1f924eb-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d46cg\" (UID: \"cf64d983-9da3-4030-9cb0-64e8d1f924eb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:19.723505 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.723441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf64d983-9da3-4030-9cb0-64e8d1f924eb-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d46cg\" (UID: \"cf64d983-9da3-4030-9cb0-64e8d1f924eb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:19.732985 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.732938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc6v6\" (UniqueName: \"kubernetes.io/projected/cf64d983-9da3-4030-9cb0-64e8d1f924eb-kube-api-access-nc6v6\") pod \"monitoring-plugin-5d85778b9d-d46cg\" (UID: \"cf64d983-9da3-4030-9cb0-64e8d1f924eb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:19.737427 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.737400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:19.838169 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.838130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:19.844191 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.844162    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:19.938807 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:19.938748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:20.089764 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.089501    2564 patch_prober.go:28] interesting pod/image-registry-9bbdcc78c-tl4z9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 11:40:20.089764 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.089563    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9" podUID="665aa985-95ba-4c08-a6f5-92bce7c4d488" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 11:40:20.172622 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.172561    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bfbcd57f6-v787l"]
Sep 15 11:40:20.175374 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.175127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"]
Sep 15 11:40:20.176877 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.176840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:20.314131 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.314090    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh" event={"ID":"28c9f38a-73b8-4a68-bf70-ba11a40a38ac","Type":"ContainerStarted","Data":"68a99de8c24de7a878e2774fd06ab62b4669b4aa18f4f0344464fa520f32ff6a"}
Sep 15 11:40:20.314321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.314174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh" event={"ID":"28c9f38a-73b8-4a68-bf70-ba11a40a38ac","Type":"ContainerStarted","Data":"02e90b3ea9e8951e5a43eff6647b3cd55ad66bbe05c72821de7cea9e095a0583"}
Sep 15 11:40:20.314321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.314233    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh" event={"ID":"28c9f38a-73b8-4a68-bf70-ba11a40a38ac","Type":"ContainerStarted","Data":"1cacfd749baa78da7d0d6fcf50d7970c03d32b987d0dca246330f04fa88bee64"}
Sep 15 11:40:20.315289 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.315255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg" event={"ID":"cf64d983-9da3-4030-9cb0-64e8d1f924eb","Type":"ContainerStarted","Data":"c2b2ab2a02b7e476eea06a7911d1ebd691f2fd8137e3f754dc44d8602bef4558"}
Sep 15 11:40:20.316531 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:20.316501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l" event={"ID":"664c0e09-c5a4-46b1-887b-226fa7d63366","Type":"ContainerStarted","Data":"7cbddae2384bd1fd0ba237ad5b89e998315b1f4ac1922312b04018c3439afa7b"}
Sep 15 11:40:21.048490 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.048452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:21.056552 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.054868    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:40:21.059923 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.059863    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.062670 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.062644    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 15 11:40:21.063328 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.063302    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 15 11:40:21.063736 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.063715    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 15 11:40:21.063969 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.063952    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 15 11:40:21.067682 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.064630    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 15 11:40:21.067682 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.064667    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 15 11:40:21.067682 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.064873    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 15 11:40:21.067682 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.065417    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 15 11:40:21.067932 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.067796    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 15 11:40:21.067932 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.067881    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sq8wf\""
Sep 15 11:40:21.068338 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.068312    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 15 11:40:21.069058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.068576    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 15 11:40:21.069058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.068820    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 15 11:40:21.069299 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.069279    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 15 11:40:21.069618 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.069306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aa53om3jmqqkr\""
Sep 15 11:40:21.075312 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.075119    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 15 11:40:21.076026 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.076007    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:40:21.135492 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwqvh\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-kube-api-access-xwqvh\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-config\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135647    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.135975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.135955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.136453 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.136000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.136453 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.136075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.136453 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.136108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.136453 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.136136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.203701 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.203648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:21.237037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.236966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwqvh\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-kube-api-access-xwqvh\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-config\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237238    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237597    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237803    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.237945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.237830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.240637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.238515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.240637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.238932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.240637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.239438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.240637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.239453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.240934 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.240641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.241501 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.241327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.241501 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.241408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.241663 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.241605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.241867 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.241845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.243568 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.243047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.243568 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.243111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.243568 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.243514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.243770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.243734    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.244212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.244180    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.244392 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.244207    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-config\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.245569 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.245371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.246041 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.246022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwqvh\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-kube-api-access-xwqvh\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.246399 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.246377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.246502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.246445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.247000 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.246969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.304842 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.304732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:21.378484 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.378182    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:21.701281 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:21.701252    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:40:21.704775 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:21.704737    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7006ec09_71f7_479a_971b_52c56d6379e0.slice/crio-776b12a94948d4340a5a13cc7a5330b5806751b49af7d71de415b85c6127f6e1 WatchSource:0}: Error finding container 776b12a94948d4340a5a13cc7a5330b5806751b49af7d71de415b85c6127f6e1: Status 404 returned error can't find the container with id 776b12a94948d4340a5a13cc7a5330b5806751b49af7d71de415b85c6127f6e1
Sep 15 11:40:22.214662 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.214482    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:40:22.333074 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.333038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh" event={"ID":"28c9f38a-73b8-4a68-bf70-ba11a40a38ac","Type":"ContainerStarted","Data":"b7b612f8d9e791704cdc1a26320b6187dff16ad4781cc67a36c3437d322827f9"}
Sep 15 11:40:22.335061 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.335025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerStarted","Data":"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"}
Sep 15 11:40:22.335185 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.335100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerStarted","Data":"776b12a94948d4340a5a13cc7a5330b5806751b49af7d71de415b85c6127f6e1"}
Sep 15 11:40:22.339824 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.339795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerStarted","Data":"f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406"}
Sep 15 11:40:22.339921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.339868    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerStarted","Data":"8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3"}
Sep 15 11:40:22.339921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.339915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerStarted","Data":"11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8"}
Sep 15 11:40:22.340016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.339958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerStarted","Data":"1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223"}
Sep 15 11:40:22.340016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.339999    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerStarted","Data":"5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564"}
Sep 15 11:40:22.371879 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.371700    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:22.470868 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:22.470768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:23.347787 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.347745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh" event={"ID":"28c9f38a-73b8-4a68-bf70-ba11a40a38ac","Type":"ContainerStarted","Data":"95ab4c585a8c2a6389e79ae9ab9f33d649d11484b968059b6436a1d4306ffd92"}
Sep 15 11:40:23.348238 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.347870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh" event={"ID":"28c9f38a-73b8-4a68-bf70-ba11a40a38ac","Type":"ContainerStarted","Data":"55369c4893212bdd5f46fce1dd4cb4feff99a83033f85dd75e91df2541d1f135"}
Sep 15 11:40:23.348238 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.347953    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:23.349750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.349720    2564 generic.go:356] "Generic (PLEG): container finished" podID="7006ec09-71f7-479a-971b-52c56d6379e0" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7" exitCode=0
Sep 15 11:40:23.349865 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.349808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerDied","Data":"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"}
Sep 15 11:40:23.354227 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.354195    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerStarted","Data":"8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59"}
Sep 15 11:40:23.356123 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.356092    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg" event={"ID":"cf64d983-9da3-4030-9cb0-64e8d1f924eb","Type":"ContainerStarted","Data":"01df6006cc28357e4ded7b87ca57ff255c031339a0fa649030a07bce4624bf46"}
Sep 15 11:40:23.356234 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.356203    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:23.358346 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.358301    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l" event={"ID":"664c0e09-c5a4-46b1-887b-226fa7d63366","Type":"ContainerStarted","Data":"05dfbb2c17ffc7650e53af03b48d3ff7306ade879796a013181b2c4a44259be2"}
Sep 15 11:40:23.361595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.361575    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg"
Sep 15 11:40:23.388850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.388645    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh" podStartSLOduration=3.376137782 podStartE2EDuration="7.388629071s" totalImagesPullingTime="4.012491289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:23.387050436 +0000 UTC m=+121.110792124" watchObservedRunningTime="2026-09-15 11:40:23.388629071 +0000 UTC m=+121.112370759"
Sep 15 11:40:23.412816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.412762    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.732268128 podStartE2EDuration="8.412743912s" totalImagesPullingTime="4.663010974s" totalInitContainerRuntime="17.46481ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:23.411455216 +0000 UTC m=+121.135196902" watchObservedRunningTime="2026-09-15 11:40:23.412743912 +0000 UTC m=+121.136485599"
Sep 15 11:40:23.430064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.430009    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l" podStartSLOduration=1.663484243 podStartE2EDuration="4.429989509s" totalImagesPullingTime="2.766505266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:23.429201771 +0000 UTC m=+121.152943458" watchObservedRunningTime="2026-09-15 11:40:23.429989509 +0000 UTC m=+121.153731195"
Sep 15 11:40:23.447120 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:23.447076    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d46cg" podStartSLOduration=1.682163864 podStartE2EDuration="4.447062543s" totalImagesPullingTime="2.764898679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:23.446731009 +0000 UTC m=+121.170472696" watchObservedRunningTime="2026-09-15 11:40:23.447062543 +0000 UTC m=+121.170804228"
Sep 15 11:40:25.285559 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:25.284875    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9bbdcc78c-tl4z9"]
Sep 15 11:40:25.358279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:25.358244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:25.432083 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:25.432049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:25.496761 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:25.496682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:27.394137 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:27.393957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerStarted","Data":"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"}
Sep 15 11:40:27.394137 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:27.394044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerStarted","Data":"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"}
Sep 15 11:40:27.394137 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:27.394089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerStarted","Data":"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"}
Sep 15 11:40:28.408566 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:28.408526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerStarted","Data":"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"}
Sep 15 11:40:28.408990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:28.408728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerStarted","Data":"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"}
Sep 15 11:40:28.408990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:28.408767    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerStarted","Data":"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"}
Sep 15 11:40:28.437797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:28.437663    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.609911823 podStartE2EDuration="7.437642979s" totalImagesPullingTime="3.80542202s" totalInitContainerRuntime="22.309136ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:28.436278668 +0000 UTC m=+126.160020375" watchObservedRunningTime="2026-09-15 11:40:28.437642979 +0000 UTC m=+126.161384662"
Sep 15 11:40:29.371499 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:29.371467    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b4f87946-8rwsh"
Sep 15 11:40:31.379463 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:31.379420    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:31.555085 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:31.555040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:40:31.557572 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:31.557545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b4bade6-b906-4b46-a9cc-72134fdfa6c3-metrics-certs\") pod \"network-metrics-daemon-9xmv5\" (UID: \"8b4bade6-b906-4b46-a9cc-72134fdfa6c3\") " pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:40:31.562649 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:31.562626    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dmnh2\""
Sep 15 11:40:31.570655 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:31.570632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xmv5"
Sep 15 11:40:32.428093 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:32.428057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:32.529640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:32.529607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:33.639821 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:33.639774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:33.739616 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:33.739580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:34.157368 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:34.157329    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:34.222431 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:34.222394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:36.147144 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:36.147107    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:36.211620 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:36.211576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:36.580550 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:36.580514    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9xmv5"]
Sep 15 11:40:36.583816 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:40:36.583784    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4bade6_b906_4b46_a9cc_72134fdfa6c3.slice/crio-b88fdbb37ab573e764787113435e74f9fa5dc61e9f8024ef2377927c1be376e7 WatchSource:0}: Error finding container b88fdbb37ab573e764787113435e74f9fa5dc61e9f8024ef2377927c1be376e7: Status 404 returned error can't find the container with id b88fdbb37ab573e764787113435e74f9fa5dc61e9f8024ef2377927c1be376e7
Sep 15 11:40:37.460356 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:37.460318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9xmv5" event={"ID":"8b4bade6-b906-4b46-a9cc-72134fdfa6c3","Type":"ContainerStarted","Data":"b88fdbb37ab573e764787113435e74f9fa5dc61e9f8024ef2377927c1be376e7"}
Sep 15 11:40:37.463957 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:37.463410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-rzfhv" event={"ID":"9566d059-9587-4aa4-914a-41bc092ad17f","Type":"ContainerStarted","Data":"e1c37aed5e2db404bf70ed52b2674b5b9f6febaedc2979d4004126ed9f83a822"}
Sep 15 11:40:37.464398 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:37.464335    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-rzfhv"
Sep 15 11:40:37.483590 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:37.483559    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-rzfhv"
Sep 15 11:40:37.496536 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:37.496478    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-rzfhv" podStartSLOduration=1.721157491 podStartE2EDuration="19.496460985s" totalImagesPullingTime="17.775303494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:37.494340825 +0000 UTC m=+135.218082512" watchObservedRunningTime="2026-09-15 11:40:37.496460985 +0000 UTC m=+135.220202671"
Sep 15 11:40:38.356204 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:38.356165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:38.457737 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:38.457691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:38.470323 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:38.470258    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9xmv5" event={"ID":"8b4bade6-b906-4b46-a9cc-72134fdfa6c3","Type":"ContainerStarted","Data":"9ef6792111a89c650d95542991c938af385146824dcf87b58c55bf0fefbbb9cd"}
Sep 15 11:40:39.392112 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:39.392075    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:39.392311 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:39.392138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:39.478670 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:39.478628    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9xmv5" event={"ID":"8b4bade6-b906-4b46-a9cc-72134fdfa6c3","Type":"ContainerStarted","Data":"326cc52ffcd912082515935a3b6019374b0da13830c4ccfe4ecd65f913800253"}
Sep 15 11:40:39.500325 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:39.500266    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9xmv5" podStartSLOduration=134.806219154 podStartE2EDuration="2m16.500245852s" totalImagesPullingTime="1.694026698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:39.498686779 +0000 UTC m=+137.222428467" watchObservedRunningTime="2026-09-15 11:40:39.500245852 +0000 UTC m=+137.223987545"
Sep 15 11:40:39.610147 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:39.610111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:39.709886 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:39.709851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:41.432738 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:41.432701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.539156 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:42.539121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.608736 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:42.608697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.715631 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:42.715593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:42.776042 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:42.776006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:44.523676 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:44.523642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:44.579196 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:44.579140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:45.878719 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:45.878687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:45.975157 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:45.975126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:46.074285 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:46.074242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:47.165119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:47.165073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:47.227973 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:47.227938    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:49.445560 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:49.445511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:49.545681 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:49.545646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:49.609409 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:49.609375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:50.309899 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.309859    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9" podUID="665aa985-95ba-4c08-a6f5-92bce7c4d488" containerName="registry" containerID="cri-o://a720bf6f94c34616039ebc3f8ec51c522375fbbca7f666af6ed2e04faa96e71a" gracePeriod=30
Sep 15 11:40:50.531355 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.531324    2564 generic.go:356] "Generic (PLEG): container finished" podID="665aa985-95ba-4c08-a6f5-92bce7c4d488" containerID="a720bf6f94c34616039ebc3f8ec51c522375fbbca7f666af6ed2e04faa96e71a" exitCode=0
Sep 15 11:40:50.531778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.531391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9" event={"ID":"665aa985-95ba-4c08-a6f5-92bce7c4d488","Type":"ContainerDied","Data":"a720bf6f94c34616039ebc3f8ec51c522375fbbca7f666af6ed2e04faa96e71a"}
Sep 15 11:40:50.592852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.592828    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:40:50.636305 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636280    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-trusted-ca\") pod \"665aa985-95ba-4c08-a6f5-92bce7c4d488\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") "
Sep 15 11:40:50.636471 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636323    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-certificates\") pod \"665aa985-95ba-4c08-a6f5-92bce7c4d488\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") "
Sep 15 11:40:50.636471 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636349    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-image-registry-private-configuration\") pod \"665aa985-95ba-4c08-a6f5-92bce7c4d488\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") "
Sep 15 11:40:50.636471 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636397    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jpgp\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-kube-api-access-6jpgp\") pod \"665aa985-95ba-4c08-a6f5-92bce7c4d488\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") "
Sep 15 11:40:50.636471 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/665aa985-95ba-4c08-a6f5-92bce7c4d488-ca-trust-extracted\") pod \"665aa985-95ba-4c08-a6f5-92bce7c4d488\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") "
Sep 15 11:40:50.636701 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636472    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-installation-pull-secrets\") pod \"665aa985-95ba-4c08-a6f5-92bce7c4d488\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") "
Sep 15 11:40:50.636701 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-bound-sa-token\") pod \"665aa985-95ba-4c08-a6f5-92bce7c4d488\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") "
Sep 15 11:40:50.636701 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636543    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") pod \"665aa985-95ba-4c08-a6f5-92bce7c4d488\" (UID: \"665aa985-95ba-4c08-a6f5-92bce7c4d488\") "
Sep 15 11:40:50.636857 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636726    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "665aa985-95ba-4c08-a6f5-92bce7c4d488" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:50.636857 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636734    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "665aa985-95ba-4c08-a6f5-92bce7c4d488" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:50.636857 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636841    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-trusted-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.637014 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.636865    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-certificates\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.639437 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.639412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "665aa985-95ba-4c08-a6f5-92bce7c4d488" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:50.639571 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.639412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-kube-api-access-6jpgp" (OuterVolumeSpecName: "kube-api-access-6jpgp") pod "665aa985-95ba-4c08-a6f5-92bce7c4d488" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488"). InnerVolumeSpecName "kube-api-access-6jpgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:50.639571 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.639424    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "665aa985-95ba-4c08-a6f5-92bce7c4d488" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:50.639571 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.639514    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "665aa985-95ba-4c08-a6f5-92bce7c4d488" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:50.639680 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.639575    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "665aa985-95ba-4c08-a6f5-92bce7c4d488" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:50.645495 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.645464    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665aa985-95ba-4c08-a6f5-92bce7c4d488-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "665aa985-95ba-4c08-a6f5-92bce7c4d488" (UID: "665aa985-95ba-4c08-a6f5-92bce7c4d488"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:50.737834 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.737794    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-installation-pull-secrets\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.737834 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.737825    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-bound-sa-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.737834 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.737838    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-registry-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.738066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.737852    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/665aa985-95ba-4c08-a6f5-92bce7c4d488-image-registry-private-configuration\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.738066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.737864    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jpgp\" (UniqueName: \"kubernetes.io/projected/665aa985-95ba-4c08-a6f5-92bce7c4d488-kube-api-access-6jpgp\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:40:50.738066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:50.737875    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/665aa985-95ba-4c08-a6f5-92bce7c4d488-ca-trust-extracted\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:40:51.540754 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:51.540724    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9"
Sep 15 11:40:51.540754 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:51.540744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9bbdcc78c-tl4z9" event={"ID":"665aa985-95ba-4c08-a6f5-92bce7c4d488","Type":"ContainerDied","Data":"cd1b4b4ecf9121533283af788b763d60def91ef5b705490ba9c57758d824ec38"}
Sep 15 11:40:51.541204 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:51.540825    2564 scope.go:117] "RemoveContainer" containerID="a720bf6f94c34616039ebc3f8ec51c522375fbbca7f666af6ed2e04faa96e71a"
Sep 15 11:40:51.560293 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:51.560269    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9bbdcc78c-tl4z9"]
Sep 15 11:40:51.563928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:51.563907    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9bbdcc78c-tl4z9"]
Sep 15 11:40:52.754878 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:52.754840    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="665aa985-95ba-4c08-a6f5-92bce7c4d488" path="/var/lib/kubelet/pods/665aa985-95ba-4c08-a6f5-92bce7c4d488/volumes"
Sep 15 11:40:57.542237 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:57.542182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:57.607838 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:57.607807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:59.397893 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:59.397861    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:40:59.401773 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:40:59.401755    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-bfbcd57f6-v787l"
Sep 15 11:41:09.465701 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:09.465667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:09.563624 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:09.563592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:21.379176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:21.379089    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:21.394809 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:21.394782    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:21.676910 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:21.676826    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:34.034504 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:34.034467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:34.134419 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:34.134378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:35.089560 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.089525    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:41:35.090035 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.089809    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="alertmanager" containerID="cri-o://5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564" gracePeriod=120
Sep 15 11:41:35.090035 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.089873    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy-metric" containerID="cri-o://f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406" gracePeriod=120
Sep 15 11:41:35.090035 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.089919    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy" containerID="cri-o://8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3" gracePeriod=120
Sep 15 11:41:35.090035 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.089954    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="config-reloader" containerID="cri-o://1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223" gracePeriod=120
Sep 15 11:41:35.090035 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.089959    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="prom-label-proxy" containerID="cri-o://8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59" gracePeriod=120
Sep 15 11:41:35.090035 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.089907    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy-web" containerID="cri-o://11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8" gracePeriod=120
Sep 15 11:41:35.719750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719716    2564 generic.go:356] "Generic (PLEG): container finished" podID="6399541b-10c1-484d-abe6-b61d938b2f08" containerID="8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59" exitCode=0
Sep 15 11:41:35.719750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719742    2564 generic.go:356] "Generic (PLEG): container finished" podID="6399541b-10c1-484d-abe6-b61d938b2f08" containerID="f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406" exitCode=0
Sep 15 11:41:35.719750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719748    2564 generic.go:356] "Generic (PLEG): container finished" podID="6399541b-10c1-484d-abe6-b61d938b2f08" containerID="8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3" exitCode=0
Sep 15 11:41:35.719750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719753    2564 generic.go:356] "Generic (PLEG): container finished" podID="6399541b-10c1-484d-abe6-b61d938b2f08" containerID="1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223" exitCode=0
Sep 15 11:41:35.719750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719758    2564 generic.go:356] "Generic (PLEG): container finished" podID="6399541b-10c1-484d-abe6-b61d938b2f08" containerID="5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564" exitCode=0
Sep 15 11:41:35.720037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerDied","Data":"8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59"}
Sep 15 11:41:35.720037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerDied","Data":"f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406"}
Sep 15 11:41:35.720037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerDied","Data":"8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3"}
Sep 15 11:41:35.720037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerDied","Data":"1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223"}
Sep 15 11:41:35.720037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:35.719934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerDied","Data":"5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564"}
Sep 15 11:41:36.338674 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.338651    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.421514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-main-db\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421461    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421479    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-metrics-client-ca\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421502    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421549    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-tls-assets\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421585    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-config-volume\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421621    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8248\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-kube-api-access-k8248\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-config-out\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421701    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-trusted-ca-bundle\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421736    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-web-config\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.421786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421767    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:36.422131 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421763    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-cluster-tls-config\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.422131 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421825    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.422131 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.421870    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-web\") pod \"6399541b-10c1-484d-abe6-b61d938b2f08\" (UID: \"6399541b-10c1-484d-abe6-b61d938b2f08\") "
Sep 15 11:41:36.422303 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.422132    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-main-db\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.422303 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.422132    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:36.422303 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.422277    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:36.424753 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.424720    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:36.424953 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.424929    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-kube-api-access-k8248" (OuterVolumeSpecName: "kube-api-access-k8248") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "kube-api-access-k8248". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:36.426510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.425706    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-config-out" (OuterVolumeSpecName: "config-out") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:36.426510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.425717    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:36.426510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.425736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:36.426510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.425720    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:36.427176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.427149    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-config-volume" (OuterVolumeSpecName: "config-volume") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:36.427502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.427476    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:36.431902 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.431875    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:36.438937 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.438914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-web-config" (OuterVolumeSpecName: "web-config") pod "6399541b-10c1-484d-abe6-b61d938b2f08" (UID: "6399541b-10c1-484d-abe6-b61d938b2f08"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:36.522739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522697    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-tls-assets\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522735    2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-config-volume\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522745    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8248\" (UniqueName: \"kubernetes.io/projected/6399541b-10c1-484d-abe6-b61d938b2f08-kube-api-access-k8248\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522753    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6399541b-10c1-484d-abe6-b61d938b2f08-config-out\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522762    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522771    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-web-config\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522779    2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-cluster-tls-config\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522787    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522796    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522804    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-main-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522812    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6399541b-10c1-484d-abe6-b61d938b2f08-metrics-client-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.522987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.522820    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6399541b-10c1-484d-abe6-b61d938b2f08-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:36.726419 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.726372    2564 generic.go:356] "Generic (PLEG): container finished" podID="6399541b-10c1-484d-abe6-b61d938b2f08" containerID="11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8" exitCode=0
Sep 15 11:41:36.726608 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.726414    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerDied","Data":"11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8"}
Sep 15 11:41:36.726608 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.726446    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.726608 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.726506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6399541b-10c1-484d-abe6-b61d938b2f08","Type":"ContainerDied","Data":"c73a932d4d85e6c5c835dda2dd6c7f1d34d17d2be0de32c8523a5256b045acf7"}
Sep 15 11:41:36.726608 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.726556    2564 scope.go:117] "RemoveContainer" containerID="8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59"
Sep 15 11:41:36.738787 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.738768    2564 scope.go:117] "RemoveContainer" containerID="f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406"
Sep 15 11:41:36.746104 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.746083    2564 scope.go:117] "RemoveContainer" containerID="8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3"
Sep 15 11:41:36.753032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.753011    2564 scope.go:117] "RemoveContainer" containerID="11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8"
Sep 15 11:41:36.756308 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.756281    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:41:36.760862 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.760838    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:41:36.761747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.761725    2564 scope.go:117] "RemoveContainer" containerID="1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223"
Sep 15 11:41:36.768832 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.768813    2564 scope.go:117] "RemoveContainer" containerID="5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564"
Sep 15 11:41:36.775812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.775793    2564 scope.go:117] "RemoveContainer" containerID="4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1"
Sep 15 11:41:36.783390 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.783374    2564 scope.go:117] "RemoveContainer" containerID="8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59"
Sep 15 11:41:36.783690 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:36.783670    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59\": container with ID starting with 8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59 not found: ID does not exist" containerID="8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59"
Sep 15 11:41:36.783743 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.783700    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59"} err="failed to get container status \"8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59\": rpc error: code = NotFound desc = could not find container \"8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59\": container with ID starting with 8ccf03a0617e2d1c70399694cc8c0a3a4a3673c3015ee0b35a36caac6719dd59 not found: ID does not exist"
Sep 15 11:41:36.783743 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.783735    2564 scope.go:117] "RemoveContainer" containerID="f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406"
Sep 15 11:41:36.783970 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:36.783951    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406\": container with ID starting with f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406 not found: ID does not exist" containerID="f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406"
Sep 15 11:41:36.784018 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.783983    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406"} err="failed to get container status \"f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406\": rpc error: code = NotFound desc = could not find container \"f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406\": container with ID starting with f0b356aca7733e8d65c3219882af04113022c31fb234d649c9b02527f32ab406 not found: ID does not exist"
Sep 15 11:41:36.784018 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.783999    2564 scope.go:117] "RemoveContainer" containerID="8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3"
Sep 15 11:41:36.784278 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:36.784257    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3\": container with ID starting with 8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3 not found: ID does not exist" containerID="8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3"
Sep 15 11:41:36.784344 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.784285    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3"} err="failed to get container status \"8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3\": rpc error: code = NotFound desc = could not find container \"8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3\": container with ID starting with 8c774e59cb915ae5c6903c497fc48e15e139807dd6d8c18666dbad3465ce12d3 not found: ID does not exist"
Sep 15 11:41:36.784344 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.784300    2564 scope.go:117] "RemoveContainer" containerID="11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8"
Sep 15 11:41:36.784512 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:36.784496    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8\": container with ID starting with 11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8 not found: ID does not exist" containerID="11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8"
Sep 15 11:41:36.784552 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.784516    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8"} err="failed to get container status \"11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8\": rpc error: code = NotFound desc = could not find container \"11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8\": container with ID starting with 11d4619d878fcec45a932d8abc711902b3979b9b7d51d61a068d0eee6164c6a8 not found: ID does not exist"
Sep 15 11:41:36.784552 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.784530    2564 scope.go:117] "RemoveContainer" containerID="1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223"
Sep 15 11:41:36.784771 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:36.784756    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223\": container with ID starting with 1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223 not found: ID does not exist" containerID="1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223"
Sep 15 11:41:36.784816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.784775    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223"} err="failed to get container status \"1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223\": rpc error: code = NotFound desc = could not find container \"1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223\": container with ID starting with 1843d8d2975ebc90648ef3b32d6a3a7782e766dede7e30ccd44822f75dbbc223 not found: ID does not exist"
Sep 15 11:41:36.784816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.784788    2564 scope.go:117] "RemoveContainer" containerID="5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564"
Sep 15 11:41:36.785000 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:36.784981    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564\": container with ID starting with 5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564 not found: ID does not exist" containerID="5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564"
Sep 15 11:41:36.785059 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.785007    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564"} err="failed to get container status \"5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564\": rpc error: code = NotFound desc = could not find container \"5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564\": container with ID starting with 5466d747e3239433b68d3884f58f8e7b102651dc63227ef8176d3ce168a77564 not found: ID does not exist"
Sep 15 11:41:36.785059 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.785027    2564 scope.go:117] "RemoveContainer" containerID="4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1"
Sep 15 11:41:36.785311 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:36.785294    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1\": container with ID starting with 4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1 not found: ID does not exist" containerID="4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1"
Sep 15 11:41:36.785371 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.785312    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1"} err="failed to get container status \"4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1\": rpc error: code = NotFound desc = could not find container \"4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1\": container with ID starting with 4b842ac245dd71bc272313aaa935573cb1d1ff14dcbe52b15e6080fee86c90d1 not found: ID does not exist"
Sep 15 11:41:36.791165 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791141    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:41:36.791507 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791491    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665aa985-95ba-4c08-a6f5-92bce7c4d488" containerName="registry"
Sep 15 11:41:36.791575 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791509    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="665aa985-95ba-4c08-a6f5-92bce7c4d488" containerName="registry"
Sep 15 11:41:36.791575 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791531    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="init-config-reloader"
Sep 15 11:41:36.791575 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791541    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="init-config-reloader"
Sep 15 11:41:36.791575 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791555    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="config-reloader"
Sep 15 11:41:36.791575 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791564    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="config-reloader"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791583    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy-web"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791591    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy-web"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791606    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791614    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791622    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy-metric"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791632    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy-metric"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791645    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="alertmanager"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791654    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="alertmanager"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791668    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="prom-label-proxy"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791676    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="prom-label-proxy"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791756    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy-web"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791767    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="prom-label-proxy"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791775    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="665aa985-95ba-4c08-a6f5-92bce7c4d488" containerName="registry"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791787    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="config-reloader"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791797    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="alertmanager"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791807    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy"
Sep 15 11:41:36.791825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.791815    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" containerName="kube-rbac-proxy-metric"
Sep 15 11:41:36.795917 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.795899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.800262 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800240    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 11:41:36.800408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800283    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 11:41:36.800408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 11:41:36.800408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800244    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 11:41:36.800408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800315    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 11:41:36.800641 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800249    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 11:41:36.800641 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 11:41:36.800641 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800503    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 11:41:36.800641 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.800620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9kp48\""
Sep 15 11:41:36.805176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.805157    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 11:41:36.811409 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.811385    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:41:36.825343 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/699401a3-de3b-44cf-8230-7520290908c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/699401a3-de3b-44cf-8230-7520290908c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49lfx\" (UniqueName: \"kubernetes.io/projected/699401a3-de3b-44cf-8230-7520290908c6-kube-api-access-49lfx\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825776 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825776 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/699401a3-de3b-44cf-8230-7520290908c6-config-out\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825776 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825776 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/699401a3-de3b-44cf-8230-7520290908c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825776 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825776 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/699401a3-de3b-44cf-8230-7520290908c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.825776 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.825640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-web-config\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.926777 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.926724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/699401a3-de3b-44cf-8230-7520290908c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.926777 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.926776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/699401a3-de3b-44cf-8230-7520290908c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.926816    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.926836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.926858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.926917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49lfx\" (UniqueName: \"kubernetes.io/projected/699401a3-de3b-44cf-8230-7520290908c6-kube-api-access-49lfx\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.926966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.926990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/699401a3-de3b-44cf-8230-7520290908c6-config-out\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.927017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927409 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.927290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/699401a3-de3b-44cf-8230-7520290908c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927863 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.927837    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/699401a3-de3b-44cf-8230-7520290908c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927991 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.927890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927991 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.927921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/699401a3-de3b-44cf-8230-7520290908c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927991 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.927928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/699401a3-de3b-44cf-8230-7520290908c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.927991 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.927946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-web-config\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930015 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.929964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/699401a3-de3b-44cf-8230-7520290908c6-config-out\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930015 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.929983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930178 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.930055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930488 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.930464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.930497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.930522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/699401a3-de3b-44cf-8230-7520290908c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930731 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.930711    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-web-config\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930790 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.930756    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/699401a3-de3b-44cf-8230-7520290908c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.930842 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.930828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.931587 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.931569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/699401a3-de3b-44cf-8230-7520290908c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:36.935813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:36.935790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49lfx\" (UniqueName: \"kubernetes.io/projected/699401a3-de3b-44cf-8230-7520290908c6-kube-api-access-49lfx\") pod \"alertmanager-main-0\" (UID: \"699401a3-de3b-44cf-8230-7520290908c6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:37.106795 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:37.106705    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:41:37.389377 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:37.389349    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:41:37.391411 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:41:37.391382    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699401a3_de3b_44cf_8230_7520290908c6.slice/crio-f245476f8e89302380b1b6a64644a4243bf801f87af39eb1466a2403006577d9 WatchSource:0}: Error finding container f245476f8e89302380b1b6a64644a4243bf801f87af39eb1466a2403006577d9: Status 404 returned error can't find the container with id f245476f8e89302380b1b6a64644a4243bf801f87af39eb1466a2403006577d9
Sep 15 11:41:37.732699 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:37.732665    2564 generic.go:356] "Generic (PLEG): container finished" podID="699401a3-de3b-44cf-8230-7520290908c6" containerID="bdf98c0709f0b9430900a8ccd6a7ce9d1c7f6afc63651d56a9cc6b5f9f4114fb" exitCode=0
Sep 15 11:41:37.732853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:37.732706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"699401a3-de3b-44cf-8230-7520290908c6","Type":"ContainerDied","Data":"bdf98c0709f0b9430900a8ccd6a7ce9d1c7f6afc63651d56a9cc6b5f9f4114fb"}
Sep 15 11:41:37.732853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:37.732755    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"699401a3-de3b-44cf-8230-7520290908c6","Type":"ContainerStarted","Data":"f245476f8e89302380b1b6a64644a4243bf801f87af39eb1466a2403006577d9"}
Sep 15 11:41:38.740233 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:38.740178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"699401a3-de3b-44cf-8230-7520290908c6","Type":"ContainerStarted","Data":"a5e60b5cdf2cb99deaeff8debcff962e1e2921c007e85d0c2e061fa86040cb99"}
Sep 15 11:41:38.740651 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:38.740295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"699401a3-de3b-44cf-8230-7520290908c6","Type":"ContainerStarted","Data":"687a2e908ea0fc5c340f66c84b71e6aca26d7db2c8484eb9b3db767cd1966a62"}
Sep 15 11:41:38.740651 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:38.740327    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"699401a3-de3b-44cf-8230-7520290908c6","Type":"ContainerStarted","Data":"d519abae4e4e1bb16cc212b04dab8b7ad88ad11df1635b03ad7aeb06a7a53abb"}
Sep 15 11:41:38.740651 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:38.740351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"699401a3-de3b-44cf-8230-7520290908c6","Type":"ContainerStarted","Data":"2fe6d3fb3ba26559b56406a47785798df13b0547b02a11d5e9bf909fdb122f82"}
Sep 15 11:41:38.740651 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:38.740374    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"699401a3-de3b-44cf-8230-7520290908c6","Type":"ContainerStarted","Data":"3eaf22cfe0f576b29e9c1cc0de7cb6c1072e0deb6bd106819270a8ab1e329e16"}
Sep 15 11:41:38.740651 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:38.740396    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"699401a3-de3b-44cf-8230-7520290908c6","Type":"ContainerStarted","Data":"4f3491cc57b266096f869fad547ca46e8835119f25c26b41903360aa345292cc"}
Sep 15 11:41:38.755412 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:38.755385    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6399541b-10c1-484d-abe6-b61d938b2f08" path="/var/lib/kubelet/pods/6399541b-10c1-484d-abe6-b61d938b2f08/volumes"
Sep 15 11:41:38.771374 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:38.771319    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.756799875 podStartE2EDuration="2.771298526s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.498651ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:38.768566208 +0000 UTC m=+196.492307904" watchObservedRunningTime="2026-09-15 11:41:38.771298526 +0000 UTC m=+196.495040213"
Sep 15 11:41:39.122626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.122531    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-896b796f6-hlbvz"]
Sep 15 11:41:39.126163 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.126145    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.129102 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.128942    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nn4dw\""
Sep 15 11:41:39.129854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.129829    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 11:41:39.129943 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.129837    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 11:41:39.129943 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.129918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 11:41:39.130087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.130060    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 11:41:39.130207 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.130107    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 11:41:39.132785 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.132763    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 11:41:39.139308 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.139285    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-896b796f6-hlbvz"]
Sep 15 11:41:39.146554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.146245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-telemeter-client-tls\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.146554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.146288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-metrics-client-ca\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.146554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.146335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-federate-client-tls\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.146554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.146412    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r98n9\" (UniqueName: \"kubernetes.io/projected/c2498440-6dbb-4196-93f9-bf3afb079681-kube-api-access-r98n9\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.146554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.146445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.146554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.146478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-telemeter-trusted-ca-bundle\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.146926 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.146581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-serving-certs-ca-bundle\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.146926 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.146656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-secret-telemeter-client\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.247952 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.247916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-metrics-client-ca\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.248132 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.247971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-federate-client-tls\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.248132 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.248024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r98n9\" (UniqueName: \"kubernetes.io/projected/c2498440-6dbb-4196-93f9-bf3afb079681-kube-api-access-r98n9\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.248132 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.248052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.248132 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.248083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-telemeter-trusted-ca-bundle\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.248132 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.248117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-serving-certs-ca-bundle\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.248419 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.248160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-secret-telemeter-client\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.248419 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.248235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-telemeter-client-tls\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.248760 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.248732    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-metrics-client-ca\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.249376 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.249349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-serving-certs-ca-bundle\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.250201 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.250176    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2498440-6dbb-4196-93f9-bf3afb079681-telemeter-trusted-ca-bundle\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.251046 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.251027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-telemeter-client-tls\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.251623 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.251595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.251710 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.251607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-secret-telemeter-client\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.251893 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.251876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2498440-6dbb-4196-93f9-bf3afb079681-federate-client-tls\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.258948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.258927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r98n9\" (UniqueName: \"kubernetes.io/projected/c2498440-6dbb-4196-93f9-bf3afb079681-kube-api-access-r98n9\") pod \"telemeter-client-896b796f6-hlbvz\" (UID: \"c2498440-6dbb-4196-93f9-bf3afb079681\") " pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.419986 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.419896    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:41:39.420483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.420213    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="prometheus" containerID="cri-o://6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f" gracePeriod=600
Sep 15 11:41:39.420483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.420257    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="thanos-sidecar" containerID="cri-o://5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287" gracePeriod=600
Sep 15 11:41:39.420483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.420287    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy-web" containerID="cri-o://6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b" gracePeriod=600
Sep 15 11:41:39.420483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.420246    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e" gracePeriod=600
Sep 15 11:41:39.420483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.420377    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy" containerID="cri-o://a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99" gracePeriod=600
Sep 15 11:41:39.420822 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.420265    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="config-reloader" containerID="cri-o://ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e" gracePeriod=600
Sep 15 11:41:39.437052 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.436971    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz"
Sep 15 11:41:39.672278 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.672195    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:39.730193 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.730171    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-896b796f6-hlbvz"]
Sep 15 11:41:39.733478 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:41:39.733438    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2498440_6dbb_4196_93f9_bf3afb079681.slice/crio-b4bd805a5c467a9019f0f9236dcb1caa8502096488bbd2c5d1ca9b71d195dc8c WatchSource:0}: Error finding container b4bd805a5c467a9019f0f9236dcb1caa8502096488bbd2c5d1ca9b71d195dc8c: Status 404 returned error can't find the container with id b4bd805a5c467a9019f0f9236dcb1caa8502096488bbd2c5d1ca9b71d195dc8c
Sep 15 11:41:39.752702 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752675    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-metrics-client-certs\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752727    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-grpc-tls\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752759    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-db\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-0\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752832    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-serving-certs-ca-bundle\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752862    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-1\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752901    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752948    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwqvh\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-kube-api-access-xwqvh\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.752994    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-tls-assets\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753025    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-thanos-prometheus-http-client-file\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-kubelet-serving-ca-bundle\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753121    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-tls\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753186    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-trusted-ca-bundle\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753273    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-metrics-client-ca\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753302    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-config\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753333    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-2\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753330    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753430    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-config-out\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753492    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-web-config\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753649    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-kube-rbac-proxy\") pod \"7006ec09-71f7-479a-971b-52c56d6379e0\" (UID: \"7006ec09-71f7-479a-971b-52c56d6379e0\") "
Sep 15 11:41:39.753812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753678    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:39.754279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.753989    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:39.754279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.754143    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.754279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.754161    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.754279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.754176    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.754474 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.754324    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:39.755046 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.754984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:39.757189 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.756984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.757537 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.757495    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:39.758764 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.758622    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.758764 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.758712    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:39.759612 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.759018    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.759612 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.759081    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-config" (OuterVolumeSpecName: "config") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.759612 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.759284    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-kube-api-access-xwqvh" (OuterVolumeSpecName: "kube-api-access-xwqvh") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "kube-api-access-xwqvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:39.759612 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.759346    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.759612 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.759398    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.761060 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.760099    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:39.761060 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.760787    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.761486 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761461    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:39.761650 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761624    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-config-out" (OuterVolumeSpecName: "config-out") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:39.761762 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761737    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.761972 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761949    2564 generic.go:356] "Generic (PLEG): container finished" podID="7006ec09-71f7-479a-971b-52c56d6379e0" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e" exitCode=0
Sep 15 11:41:39.761972 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761972    2564 generic.go:356] "Generic (PLEG): container finished" podID="7006ec09-71f7-479a-971b-52c56d6379e0" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99" exitCode=0
Sep 15 11:41:39.762087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761979    2564 generic.go:356] "Generic (PLEG): container finished" podID="7006ec09-71f7-479a-971b-52c56d6379e0" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b" exitCode=0
Sep 15 11:41:39.762087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761984    2564 generic.go:356] "Generic (PLEG): container finished" podID="7006ec09-71f7-479a-971b-52c56d6379e0" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287" exitCode=0
Sep 15 11:41:39.762087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761989    2564 generic.go:356] "Generic (PLEG): container finished" podID="7006ec09-71f7-479a-971b-52c56d6379e0" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e" exitCode=0
Sep 15 11:41:39.762087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.761994    2564 generic.go:356] "Generic (PLEG): container finished" podID="7006ec09-71f7-479a-971b-52c56d6379e0" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f" exitCode=0
Sep 15 11:41:39.762087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762034    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:39.762087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerDied","Data":"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"}
Sep 15 11:41:39.762408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762106    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerDied","Data":"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"}
Sep 15 11:41:39.762408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762149    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerDied","Data":"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"}
Sep 15 11:41:39.762408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762188    2564 scope.go:117] "RemoveContainer" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"
Sep 15 11:41:39.762408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerDied","Data":"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"}
Sep 15 11:41:39.762408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerDied","Data":"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"}
Sep 15 11:41:39.762408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762328    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerDied","Data":"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"}
Sep 15 11:41:39.762408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.762370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7006ec09-71f7-479a-971b-52c56d6379e0","Type":"ContainerDied","Data":"776b12a94948d4340a5a13cc7a5330b5806751b49af7d71de415b85c6127f6e1"}
Sep 15 11:41:39.763456 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.763428    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz" event={"ID":"c2498440-6dbb-4196-93f9-bf3afb079681","Type":"ContainerStarted","Data":"b4bd805a5c467a9019f0f9236dcb1caa8502096488bbd2c5d1ca9b71d195dc8c"}
Sep 15 11:41:39.770923 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.770902    2564 scope.go:117] "RemoveContainer" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"
Sep 15 11:41:39.775867 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.775838    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-web-config" (OuterVolumeSpecName: "web-config") pod "7006ec09-71f7-479a-971b-52c56d6379e0" (UID: "7006ec09-71f7-479a-971b-52c56d6379e0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:41:39.778344 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.778328    2564 scope.go:117] "RemoveContainer" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"
Sep 15 11:41:39.785041 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.785023    2564 scope.go:117] "RemoveContainer" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"
Sep 15 11:41:39.791555 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.791536    2564 scope.go:117] "RemoveContainer" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"
Sep 15 11:41:39.798159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.798143    2564 scope.go:117] "RemoveContainer" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"
Sep 15 11:41:39.804874 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.804860    2564 scope.go:117] "RemoveContainer" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"
Sep 15 11:41:39.811230 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.811204    2564 scope.go:117] "RemoveContainer" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"
Sep 15 11:41:39.811475 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:39.811458    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": container with ID starting with 142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e not found: ID does not exist" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"
Sep 15 11:41:39.811532 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.811483    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"} err="failed to get container status \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": rpc error: code = NotFound desc = could not find container \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": container with ID starting with 142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e not found: ID does not exist"
Sep 15 11:41:39.811532 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.811504    2564 scope.go:117] "RemoveContainer" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"
Sep 15 11:41:39.811748 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:39.811730    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": container with ID starting with a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99 not found: ID does not exist" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"
Sep 15 11:41:39.811809 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.811758    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"} err="failed to get container status \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": rpc error: code = NotFound desc = could not find container \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": container with ID starting with a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99 not found: ID does not exist"
Sep 15 11:41:39.811809 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.811781    2564 scope.go:117] "RemoveContainer" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"
Sep 15 11:41:39.812030 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:39.812012    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": container with ID starting with 6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b not found: ID does not exist" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"
Sep 15 11:41:39.812071 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.812034    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"} err="failed to get container status \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": rpc error: code = NotFound desc = could not find container \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": container with ID starting with 6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b not found: ID does not exist"
Sep 15 11:41:39.812071 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.812048    2564 scope.go:117] "RemoveContainer" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"
Sep 15 11:41:39.812358 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:39.812340    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": container with ID starting with 5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287 not found: ID does not exist" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"
Sep 15 11:41:39.812436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.812365    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"} err="failed to get container status \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": rpc error: code = NotFound desc = could not find container \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": container with ID starting with 5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287 not found: ID does not exist"
Sep 15 11:41:39.812436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.812385    2564 scope.go:117] "RemoveContainer" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"
Sep 15 11:41:39.812641 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:39.812621    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": container with ID starting with ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e not found: ID does not exist" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"
Sep 15 11:41:39.812721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.812643    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"} err="failed to get container status \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": rpc error: code = NotFound desc = could not find container \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": container with ID starting with ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e not found: ID does not exist"
Sep 15 11:41:39.812721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.812657    2564 scope.go:117] "RemoveContainer" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"
Sep 15 11:41:39.812893 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:39.812877    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": container with ID starting with 6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f not found: ID does not exist" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"
Sep 15 11:41:39.812932 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.812899    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"} err="failed to get container status \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": rpc error: code = NotFound desc = could not find container \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": container with ID starting with 6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f not found: ID does not exist"
Sep 15 11:41:39.812932 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.812913    2564 scope.go:117] "RemoveContainer" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"
Sep 15 11:41:39.813142 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:41:39.813127    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": container with ID starting with f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7 not found: ID does not exist" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"
Sep 15 11:41:39.813186 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813145    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"} err="failed to get container status \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": rpc error: code = NotFound desc = could not find container \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": container with ID starting with f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7 not found: ID does not exist"
Sep 15 11:41:39.813186 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813156    2564 scope.go:117] "RemoveContainer" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"
Sep 15 11:41:39.813389 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813373    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"} err="failed to get container status \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": rpc error: code = NotFound desc = could not find container \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": container with ID starting with 142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e not found: ID does not exist"
Sep 15 11:41:39.813427 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813390    2564 scope.go:117] "RemoveContainer" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"
Sep 15 11:41:39.813594 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813579    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"} err="failed to get container status \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": rpc error: code = NotFound desc = could not find container \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": container with ID starting with a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99 not found: ID does not exist"
Sep 15 11:41:39.813594 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813594    2564 scope.go:117] "RemoveContainer" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"
Sep 15 11:41:39.813813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813795    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"} err="failed to get container status \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": rpc error: code = NotFound desc = could not find container \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": container with ID starting with 6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b not found: ID does not exist"
Sep 15 11:41:39.813854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813814    2564 scope.go:117] "RemoveContainer" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"
Sep 15 11:41:39.814016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.813999    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"} err="failed to get container status \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": rpc error: code = NotFound desc = could not find container \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": container with ID starting with 5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287 not found: ID does not exist"
Sep 15 11:41:39.814016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814015    2564 scope.go:117] "RemoveContainer" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"
Sep 15 11:41:39.814244 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814205    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"} err="failed to get container status \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": rpc error: code = NotFound desc = could not find container \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": container with ID starting with ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e not found: ID does not exist"
Sep 15 11:41:39.814291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814245    2564 scope.go:117] "RemoveContainer" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"
Sep 15 11:41:39.814456 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814440    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"} err="failed to get container status \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": rpc error: code = NotFound desc = could not find container \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": container with ID starting with 6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f not found: ID does not exist"
Sep 15 11:41:39.814506 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814456    2564 scope.go:117] "RemoveContainer" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"
Sep 15 11:41:39.814659 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814643    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"} err="failed to get container status \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": rpc error: code = NotFound desc = could not find container \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": container with ID starting with f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7 not found: ID does not exist"
Sep 15 11:41:39.814697 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814659    2564 scope.go:117] "RemoveContainer" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"
Sep 15 11:41:39.814876 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814860    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"} err="failed to get container status \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": rpc error: code = NotFound desc = could not find container \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": container with ID starting with 142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e not found: ID does not exist"
Sep 15 11:41:39.814917 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.814876    2564 scope.go:117] "RemoveContainer" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"
Sep 15 11:41:39.815058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815040    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"} err="failed to get container status \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": rpc error: code = NotFound desc = could not find container \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": container with ID starting with a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99 not found: ID does not exist"
Sep 15 11:41:39.815095 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815057    2564 scope.go:117] "RemoveContainer" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"
Sep 15 11:41:39.815247 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815233    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"} err="failed to get container status \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": rpc error: code = NotFound desc = could not find container \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": container with ID starting with 6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b not found: ID does not exist"
Sep 15 11:41:39.815247 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815247    2564 scope.go:117] "RemoveContainer" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"
Sep 15 11:41:39.815481 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815459    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"} err="failed to get container status \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": rpc error: code = NotFound desc = could not find container \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": container with ID starting with 5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287 not found: ID does not exist"
Sep 15 11:41:39.815481 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815480    2564 scope.go:117] "RemoveContainer" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"
Sep 15 11:41:39.815691 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815670    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"} err="failed to get container status \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": rpc error: code = NotFound desc = could not find container \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": container with ID starting with ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e not found: ID does not exist"
Sep 15 11:41:39.815739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815693    2564 scope.go:117] "RemoveContainer" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"
Sep 15 11:41:39.815870 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815855    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"} err="failed to get container status \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": rpc error: code = NotFound desc = could not find container \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": container with ID starting with 6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f not found: ID does not exist"
Sep 15 11:41:39.815870 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.815869    2564 scope.go:117] "RemoveContainer" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"
Sep 15 11:41:39.816052 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816035    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"} err="failed to get container status \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": rpc error: code = NotFound desc = could not find container \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": container with ID starting with f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7 not found: ID does not exist"
Sep 15 11:41:39.816052 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816053    2564 scope.go:117] "RemoveContainer" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"
Sep 15 11:41:39.816268 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816214    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"} err="failed to get container status \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": rpc error: code = NotFound desc = could not find container \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": container with ID starting with 142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e not found: ID does not exist"
Sep 15 11:41:39.816268 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816266    2564 scope.go:117] "RemoveContainer" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"
Sep 15 11:41:39.816520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816501    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"} err="failed to get container status \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": rpc error: code = NotFound desc = could not find container \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": container with ID starting with a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99 not found: ID does not exist"
Sep 15 11:41:39.816562 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816521    2564 scope.go:117] "RemoveContainer" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"
Sep 15 11:41:39.816764 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816746    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"} err="failed to get container status \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": rpc error: code = NotFound desc = could not find container \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": container with ID starting with 6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b not found: ID does not exist"
Sep 15 11:41:39.816812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816764    2564 scope.go:117] "RemoveContainer" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"
Sep 15 11:41:39.817008 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.816988    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"} err="failed to get container status \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": rpc error: code = NotFound desc = could not find container \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": container with ID starting with 5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287 not found: ID does not exist"
Sep 15 11:41:39.817053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817008    2564 scope.go:117] "RemoveContainer" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"
Sep 15 11:41:39.817230 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817202    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"} err="failed to get container status \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": rpc error: code = NotFound desc = could not find container \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": container with ID starting with ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e not found: ID does not exist"
Sep 15 11:41:39.817275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817231    2564 scope.go:117] "RemoveContainer" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"
Sep 15 11:41:39.817428 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817413    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"} err="failed to get container status \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": rpc error: code = NotFound desc = could not find container \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": container with ID starting with 6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f not found: ID does not exist"
Sep 15 11:41:39.817465 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817428    2564 scope.go:117] "RemoveContainer" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"
Sep 15 11:41:39.817653 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817634    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"} err="failed to get container status \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": rpc error: code = NotFound desc = could not find container \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": container with ID starting with f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7 not found: ID does not exist"
Sep 15 11:41:39.817701 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817653    2564 scope.go:117] "RemoveContainer" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"
Sep 15 11:41:39.817872 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817856    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"} err="failed to get container status \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": rpc error: code = NotFound desc = could not find container \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": container with ID starting with 142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e not found: ID does not exist"
Sep 15 11:41:39.817920 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.817872    2564 scope.go:117] "RemoveContainer" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"
Sep 15 11:41:39.818092 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818071    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"} err="failed to get container status \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": rpc error: code = NotFound desc = could not find container \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": container with ID starting with a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99 not found: ID does not exist"
Sep 15 11:41:39.818140 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818093    2564 scope.go:117] "RemoveContainer" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"
Sep 15 11:41:39.818322 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818302    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"} err="failed to get container status \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": rpc error: code = NotFound desc = could not find container \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": container with ID starting with 6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b not found: ID does not exist"
Sep 15 11:41:39.818379 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818322    2564 scope.go:117] "RemoveContainer" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"
Sep 15 11:41:39.818546 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818528    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"} err="failed to get container status \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": rpc error: code = NotFound desc = could not find container \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": container with ID starting with 5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287 not found: ID does not exist"
Sep 15 11:41:39.818588 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818547    2564 scope.go:117] "RemoveContainer" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"
Sep 15 11:41:39.818749 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818731    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"} err="failed to get container status \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": rpc error: code = NotFound desc = could not find container \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": container with ID starting with ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e not found: ID does not exist"
Sep 15 11:41:39.818794 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818749    2564 scope.go:117] "RemoveContainer" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"
Sep 15 11:41:39.818944 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818931    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"} err="failed to get container status \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": rpc error: code = NotFound desc = could not find container \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": container with ID starting with 6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f not found: ID does not exist"
Sep 15 11:41:39.818987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.818944    2564 scope.go:117] "RemoveContainer" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"
Sep 15 11:41:39.819134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819120    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"} err="failed to get container status \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": rpc error: code = NotFound desc = could not find container \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": container with ID starting with f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7 not found: ID does not exist"
Sep 15 11:41:39.819134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819133    2564 scope.go:117] "RemoveContainer" containerID="142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"
Sep 15 11:41:39.819342 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819327    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e"} err="failed to get container status \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": rpc error: code = NotFound desc = could not find container \"142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e\": container with ID starting with 142d2e71145f7f45112f52c6c59de6dfcdf3f276b544ec18d65c1dd84909834e not found: ID does not exist"
Sep 15 11:41:39.819395 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819342    2564 scope.go:117] "RemoveContainer" containerID="a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"
Sep 15 11:41:39.819547 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819533    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99"} err="failed to get container status \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": rpc error: code = NotFound desc = could not find container \"a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99\": container with ID starting with a04ceaec30f592b961cd60ce1fe89cde35e319b61ec8973c999256c5417d9a99 not found: ID does not exist"
Sep 15 11:41:39.819592 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819548    2564 scope.go:117] "RemoveContainer" containerID="6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"
Sep 15 11:41:39.819774 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819757    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b"} err="failed to get container status \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": rpc error: code = NotFound desc = could not find container \"6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b\": container with ID starting with 6706b2ba751fb61d3fbfb12a128b3ace47bffa259f4b80e95c4ba1184904e82b not found: ID does not exist"
Sep 15 11:41:39.819812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819774    2564 scope.go:117] "RemoveContainer" containerID="5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"
Sep 15 11:41:39.820006 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.819987    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287"} err="failed to get container status \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": rpc error: code = NotFound desc = could not find container \"5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287\": container with ID starting with 5ed2ee1c0a00fe33157dab2f789dfafb1ea70abe026bb387518af5ae2da0c287 not found: ID does not exist"
Sep 15 11:41:39.820055 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.820006    2564 scope.go:117] "RemoveContainer" containerID="ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"
Sep 15 11:41:39.820274 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.820256    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e"} err="failed to get container status \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": rpc error: code = NotFound desc = could not find container \"ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e\": container with ID starting with ffc1095321afb49e8da56b6520390f154da539bcb49c37a7581ccd7711df4d8e not found: ID does not exist"
Sep 15 11:41:39.820324 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.820274    2564 scope.go:117] "RemoveContainer" containerID="6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"
Sep 15 11:41:39.820475 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.820460    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f"} err="failed to get container status \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": rpc error: code = NotFound desc = could not find container \"6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f\": container with ID starting with 6013859cbb543abd17ab0c5aa814137593dd779029316f5ebea3c946b1c13f6f not found: ID does not exist"
Sep 15 11:41:39.820512 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.820475    2564 scope.go:117] "RemoveContainer" containerID="f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"
Sep 15 11:41:39.820689 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.820670    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7"} err="failed to get container status \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": rpc error: code = NotFound desc = could not find container \"f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7\": container with ID starting with f40ffc037329cedbec7812c1218e321b61acd3b8b654cacd6daa5d36f32beba7 not found: ID does not exist"
Sep 15 11:41:39.855381 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855293    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855381 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855321    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855381 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855337    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-metrics-client-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855381 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855352    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-config\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855632 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855562    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-config-out\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855632 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855597    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-web-config\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855632 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855613    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-kube-rbac-proxy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855632 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855624    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-metrics-client-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855632 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855634    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-grpc-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855643    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-db\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855651    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855659    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855669    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwqvh\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-kube-api-access-xwqvh\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855676    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7006ec09-71f7-479a-971b-52c56d6379e0-tls-assets\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855685    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855693    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7006ec09-71f7-479a-971b-52c56d6379e0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:39.855771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:39.855702    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7006ec09-71f7-479a-971b-52c56d6379e0-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:41:40.087955 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.087928    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:41:40.094470 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.094448    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:41:40.122679 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.122623    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:41:40.122984 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.122969    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy-web"
Sep 15 11:41:40.122984 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.122985    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy-web"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123002    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="prometheus"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123007    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="prometheus"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123015    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123020    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123029    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy-thanos"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123034    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy-thanos"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123047    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="thanos-sidecar"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123052    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="thanos-sidecar"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123060    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="init-config-reloader"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123065    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="init-config-reloader"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123071    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="config-reloader"
Sep 15 11:41:40.123090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123076    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="config-reloader"
Sep 15 11:41:40.123539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123127    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="prometheus"
Sep 15 11:41:40.123539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123134    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy-web"
Sep 15 11:41:40.123539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123142    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="thanos-sidecar"
Sep 15 11:41:40.123539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123149    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="config-reloader"
Sep 15 11:41:40.123539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123154    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy"
Sep 15 11:41:40.123539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.123160    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" containerName="kube-rbac-proxy-thanos"
Sep 15 11:41:40.127402 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.127379    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.130013 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.129975    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 15 11:41:40.130266 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.130013    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 15 11:41:40.130266 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.129976    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 15 11:41:40.130415 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.130352    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 15 11:41:40.130415 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.130381    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 15 11:41:40.130921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.130895    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 15 11:41:40.131044 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.131027    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sq8wf\""
Sep 15 11:41:40.131116 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.131059    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 15 11:41:40.131448 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.131426    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 15 11:41:40.131622 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.131601    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 15 11:41:40.131959 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.131830    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aa53om3jmqqkr\""
Sep 15 11:41:40.131959 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.131852    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 15 11:41:40.131959 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.131883    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 15 11:41:40.132160 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.132025    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 15 11:41:40.133236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.133198    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 15 11:41:40.135767 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.135748    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 15 11:41:40.141655 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.141634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:41:40.159317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159410 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/286b806d-a8e8-4e53-8290-56f2befc5eec-config-out\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159410 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159410 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/286b806d-a8e8-4e53-8290-56f2befc5eec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2v7\" (UniqueName: \"kubernetes.io/projected/286b806d-a8e8-4e53-8290-56f2befc5eec-kube-api-access-tr2v7\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159557    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-config\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-web-config\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.159990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.159803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260580 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260580 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260752 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260752 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260752 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260752 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260752 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/286b806d-a8e8-4e53-8290-56f2befc5eec-config-out\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/286b806d-a8e8-4e53-8290-56f2befc5eec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2v7\" (UniqueName: \"kubernetes.io/projected/286b806d-a8e8-4e53-8290-56f2befc5eec-kube-api-access-tr2v7\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.260990 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.260980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.261441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.261012    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.261441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.261042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-config\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.261441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.261068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-web-config\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.261441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.261101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.261441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.261309    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.261676 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.261446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.261676 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.261579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.262270 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.262244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.262570 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.262542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.263090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.263062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.263253 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.263208    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.263866 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.263841    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.264321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.264293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.264900 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.264663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/286b806d-a8e8-4e53-8290-56f2befc5eec-config-out\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.264900 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.264724    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.266127 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.265538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/286b806d-a8e8-4e53-8290-56f2befc5eec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.266127 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.265636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.266127 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.266072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-web-config\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.266609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.266586    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.267130 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.267081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.267130 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.267116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/286b806d-a8e8-4e53-8290-56f2befc5eec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.267447 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.267429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.267505 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.267460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/286b806d-a8e8-4e53-8290-56f2befc5eec-config\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.270935 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.270916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2v7\" (UniqueName: \"kubernetes.io/projected/286b806d-a8e8-4e53-8290-56f2befc5eec-kube-api-access-tr2v7\") pod \"prometheus-k8s-0\" (UID: \"286b806d-a8e8-4e53-8290-56f2befc5eec\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.437454 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.437418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:40.733534 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.733452    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:41:40.736995 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:41:40.736963    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286b806d_a8e8_4e53_8290_56f2befc5eec.slice/crio-b1103b4411cc527c549a108a655d8c72bf47a7a20a1186037cb415a5f15de436 WatchSource:0}: Error finding container b1103b4411cc527c549a108a655d8c72bf47a7a20a1186037cb415a5f15de436: Status 404 returned error can't find the container with id b1103b4411cc527c549a108a655d8c72bf47a7a20a1186037cb415a5f15de436
Sep 15 11:41:40.758006 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.757985    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7006ec09-71f7-479a-971b-52c56d6379e0" path="/var/lib/kubelet/pods/7006ec09-71f7-479a-971b-52c56d6379e0/volumes"
Sep 15 11:41:40.768863 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:40.768841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"286b806d-a8e8-4e53-8290-56f2befc5eec","Type":"ContainerStarted","Data":"b1103b4411cc527c549a108a655d8c72bf47a7a20a1186037cb415a5f15de436"}
Sep 15 11:41:41.775683 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:41.775598    2564 generic.go:356] "Generic (PLEG): container finished" podID="286b806d-a8e8-4e53-8290-56f2befc5eec" containerID="90658045c9218dc94997bdd55f2cbb3bc786e7e47117473f248b2f1e32ce0096" exitCode=0
Sep 15 11:41:41.776104 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:41.775682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"286b806d-a8e8-4e53-8290-56f2befc5eec","Type":"ContainerDied","Data":"90658045c9218dc94997bdd55f2cbb3bc786e7e47117473f248b2f1e32ce0096"}
Sep 15 11:41:41.777986 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:41.777959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz" event={"ID":"c2498440-6dbb-4196-93f9-bf3afb079681","Type":"ContainerStarted","Data":"b5506bcd0f60db5fa067a8d9610b3ee55b0b816a177eed78f3179e6f643890f6"}
Sep 15 11:41:41.778092 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:41.778007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz" event={"ID":"c2498440-6dbb-4196-93f9-bf3afb079681","Type":"ContainerStarted","Data":"f0af2b01374e4728af1b3d406af1ed455437d8517abd82d96fa6aa8eb110b0c8"}
Sep 15 11:41:41.778092 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:41.778031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz" event={"ID":"c2498440-6dbb-4196-93f9-bf3afb079681","Type":"ContainerStarted","Data":"05ee5e8659d34f8a71e4c3c80fd67b1760b1b1a9a1640be33d1e594fb6562530"}
Sep 15 11:41:41.824284 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:41.824243    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-896b796f6-hlbvz" podStartSLOduration=1.066443152 podStartE2EDuration="2.82421039s" totalImagesPullingTime="1.757767238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:41.823067458 +0000 UTC m=+199.546809135" watchObservedRunningTime="2026-09-15 11:41:41.82421039 +0000 UTC m=+199.547952122"
Sep 15 11:41:41.987280 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:41.986827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:42.081095 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:42.081070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:42.784854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:42.784824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"286b806d-a8e8-4e53-8290-56f2befc5eec","Type":"ContainerStarted","Data":"ed5fd0ec9cf6cb2ef3ac097cff20b43153a04c2a300ee719e5ab6d7acd646344"}
Sep 15 11:41:42.785276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:42.784884    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"286b806d-a8e8-4e53-8290-56f2befc5eec","Type":"ContainerStarted","Data":"5a337271305e528609405f61556e679bf5ce2de8c577313a54a530276be82cc2"}
Sep 15 11:41:42.785276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:42.784912    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"286b806d-a8e8-4e53-8290-56f2befc5eec","Type":"ContainerStarted","Data":"586b410bbb7b53a9205956d0892de37059afe1f8327e5c98ff6e707aad0c6677"}
Sep 15 11:41:42.785276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:42.784936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"286b806d-a8e8-4e53-8290-56f2befc5eec","Type":"ContainerStarted","Data":"131ad9befe9adcd9a0c5ecf1f991c053f593e94069c11a48a1078228e4b83c27"}
Sep 15 11:41:42.785276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:42.784959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"286b806d-a8e8-4e53-8290-56f2befc5eec","Type":"ContainerStarted","Data":"a7e863b4768821de5293cf47c8f16787fd068ba7a7b78a116bfa4ea895196c94"}
Sep 15 11:41:42.785276 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:42.784980    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"286b806d-a8e8-4e53-8290-56f2befc5eec","Type":"ContainerStarted","Data":"66e03d9f927d35fc849294513cbf68952434a66c94344ed4d2a18108c90c39d9"}
Sep 15 11:41:42.813523 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:42.813471    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.791499844 podStartE2EDuration="2.813454374s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.95453ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:42.811963183 +0000 UTC m=+200.535704891" watchObservedRunningTime="2026-09-15 11:41:42.813454374 +0000 UTC m=+200.537196060"
Sep 15 11:41:45.438051 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:45.438012    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:52.809874 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:52.809842    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:52.905581 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:52.905549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:52.965988 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:41:52.965946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:40.437761 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:42:40.437729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:42:40.453202 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:42:40.453179    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:42:41.035414 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:42:41.035387    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:42:49.274052 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:42:49.273972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:49.375804 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:42:49.375773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:01.200199 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:01.200165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:01.264766 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:01.264729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:12.553286 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:12.553250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:12.649030 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:12.648997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:12.755037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:12.754999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:18.153695 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:18.153649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:18.216323 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:18.216297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:18.444417 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:18.444387    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:18.545416 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:18.545381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:19.262566 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:19.262532    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:19.362047 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:19.362014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:22.678901 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:22.678878    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 11:43:29.130059 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:29.130023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:29.190481 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:29.190458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:29.261444 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:29.261412    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:57.417202 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:57.417169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:58.727189 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:43:58.727146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:19.084680 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:19.084600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:20.027424 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:20.027399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:22.730576 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:22.730540    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:22.857343 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:22.857299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:24.242627 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:24.242578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:24.335744 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:24.335709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:24.543134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:24.543064    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:24.646389 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:24.646354    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:26.668044 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:26.668013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:26.886054 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:26.886026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:29.494130 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:29.494094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:29.561652 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:29.561616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:33.875752 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:33.875721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:35.670285 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:35.670249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:35.772480 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:35.772448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:35.898798 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:35.898761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:36.002825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:36.002792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:37.916619 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:37.916584    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"]
Sep 15 11:44:37.920062 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:37.920044    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"
Sep 15 11:44:37.922462 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:37.922437    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 11:44:37.923227 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:37.923201    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:44:37.923287 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:37.923255    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xtm8v\""
Sep 15 11:44:37.928952 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:37.928933    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"]
Sep 15 11:44:38.051980 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.051950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8efa769a-1450-40e5-ad2c-9c10b93b85a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nj9gw\" (UID: \"8efa769a-1450-40e5-ad2c-9c10b93b85a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"
Sep 15 11:44:38.052172 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.052083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxsbk\" (UniqueName: \"kubernetes.io/projected/8efa769a-1450-40e5-ad2c-9c10b93b85a6-kube-api-access-mxsbk\") pod \"openshift-lws-operator-fd8ccff4c-nj9gw\" (UID: \"8efa769a-1450-40e5-ad2c-9c10b93b85a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"
Sep 15 11:44:38.153202 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.153169    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsbk\" (UniqueName: \"kubernetes.io/projected/8efa769a-1450-40e5-ad2c-9c10b93b85a6-kube-api-access-mxsbk\") pod \"openshift-lws-operator-fd8ccff4c-nj9gw\" (UID: \"8efa769a-1450-40e5-ad2c-9c10b93b85a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"
Sep 15 11:44:38.153396 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.153213    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8efa769a-1450-40e5-ad2c-9c10b93b85a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nj9gw\" (UID: \"8efa769a-1450-40e5-ad2c-9c10b93b85a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"
Sep 15 11:44:38.153562 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.153537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8efa769a-1450-40e5-ad2c-9c10b93b85a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nj9gw\" (UID: \"8efa769a-1450-40e5-ad2c-9c10b93b85a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"
Sep 15 11:44:38.162570 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.162549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxsbk\" (UniqueName: \"kubernetes.io/projected/8efa769a-1450-40e5-ad2c-9c10b93b85a6-kube-api-access-mxsbk\") pod \"openshift-lws-operator-fd8ccff4c-nj9gw\" (UID: \"8efa769a-1450-40e5-ad2c-9c10b93b85a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"
Sep 15 11:44:38.243597 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.243565    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"
Sep 15 11:44:38.513546 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.513525    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw"]
Sep 15 11:44:38.516019 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:44:38.515985    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8efa769a_1450_40e5_ad2c_9c10b93b85a6.slice/crio-790fa36b3c7de4e5ceee273eebd1498a8d31f1cc81a658cbe02978cd3eb778b0 WatchSource:0}: Error finding container 790fa36b3c7de4e5ceee273eebd1498a8d31f1cc81a658cbe02978cd3eb778b0: Status 404 returned error can't find the container with id 790fa36b3c7de4e5ceee273eebd1498a8d31f1cc81a658cbe02978cd3eb778b0
Sep 15 11:44:38.517962 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:38.517945    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:44:39.508061 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:39.508022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw" event={"ID":"8efa769a-1450-40e5-ad2c-9c10b93b85a6","Type":"ContainerStarted","Data":"790fa36b3c7de4e5ceee273eebd1498a8d31f1cc81a658cbe02978cd3eb778b0"}
Sep 15 11:44:41.519681 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:41.519647    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw" event={"ID":"8efa769a-1450-40e5-ad2c-9c10b93b85a6","Type":"ContainerStarted","Data":"33f6e95fb11cc401121942b81a4695585a1b8ca9c1e4751dff91699e9c35865d"}
Sep 15 11:44:41.543950 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:41.543901    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nj9gw" podStartSLOduration=1.944553266 podStartE2EDuration="4.543883989s" totalImagesPullingTime="2.599330723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:41.541981122 +0000 UTC m=+379.265722819" watchObservedRunningTime="2026-09-15 11:44:41.543883989 +0000 UTC m=+379.267625674"
Sep 15 11:44:42.356316 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:42.356275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:42.457845 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:42.457810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:44.948245 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:44:44.948195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:02.082007 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:02.081957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:02.233075 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:02.233040    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:02.673931 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:02.673900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:02.922186 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:02.922151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.021477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.021447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.063015 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.062984    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"]
Sep 15 11:45:03.066617 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.066602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.068955 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.068924    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 11:45:03.069080 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.068924    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 11:45:03.069080 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.068979    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 11:45:03.069080 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.069001    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 11:45:03.069080 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.069006    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bx677\""
Sep 15 11:45:03.081596 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.081574    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"]
Sep 15 11:45:03.170387 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.170351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eff48b8e-5759-4724-a4f0-4c04ea994a90-tmp\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.170799 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.170393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eff48b8e-5759-4724-a4f0-4c04ea994a90-manifests\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.170799 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.170430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff48b8e-5759-4724-a4f0-4c04ea994a90-webhook-cert\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.170799 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.170503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz86p\" (UniqueName: \"kubernetes.io/projected/eff48b8e-5759-4724-a4f0-4c04ea994a90-kube-api-access-bz86p\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.170799 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.170551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eff48b8e-5759-4724-a4f0-4c04ea994a90-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.188269 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.188195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.271872 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.271792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz86p\" (UniqueName: \"kubernetes.io/projected/eff48b8e-5759-4724-a4f0-4c04ea994a90-kube-api-access-bz86p\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.271872 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.271839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eff48b8e-5759-4724-a4f0-4c04ea994a90-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.272065 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.271891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eff48b8e-5759-4724-a4f0-4c04ea994a90-tmp\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.272065 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.271911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eff48b8e-5759-4724-a4f0-4c04ea994a90-manifests\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.272065 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.271936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff48b8e-5759-4724-a4f0-4c04ea994a90-webhook-cert\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.272337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.272318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eff48b8e-5759-4724-a4f0-4c04ea994a90-manifests\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.274288 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.274266    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eff48b8e-5759-4724-a4f0-4c04ea994a90-tmp\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.274542 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.274524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eff48b8e-5759-4724-a4f0-4c04ea994a90-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.274640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.274619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff48b8e-5759-4724-a4f0-4c04ea994a90-webhook-cert\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.282491 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.282468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz86p\" (UniqueName: \"kubernetes.io/projected/eff48b8e-5759-4724-a4f0-4c04ea994a90-kube-api-access-bz86p\") pod \"opendatahub-operator-controller-manager-66bc7bc78c-qf58p\" (UID: \"eff48b8e-5759-4724-a4f0-4c04ea994a90\") " pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.289067 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.289041    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.376902 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.376877    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:03.388717 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.388693    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.491183 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.491151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.588692 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.588594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.654984 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.654958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"]
Sep 15 11:45:03.656913 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:45:03.656889    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff48b8e_5759_4724_a4f0_4c04ea994a90.slice/crio-eefa7ae66b228c8a562f05fd24fafe34f9ace5509329e035a6c3e7561fae93b1 WatchSource:0}: Error finding container eefa7ae66b228c8a562f05fd24fafe34f9ace5509329e035a6c3e7561fae93b1: Status 404 returned error can't find the container with id eefa7ae66b228c8a562f05fd24fafe34f9ace5509329e035a6c3e7561fae93b1
Sep 15 11:45:03.670051 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.670028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.739826 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.739796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:03.840558 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:03.840474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:04.208951 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:04.208911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:04.618756 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:04.618662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p" event={"ID":"eff48b8e-5759-4724-a4f0-4c04ea994a90","Type":"ContainerStarted","Data":"eefa7ae66b228c8a562f05fd24fafe34f9ace5509329e035a6c3e7561fae93b1"}
Sep 15 11:45:06.529172 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:06.529137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:07.637330 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:07.637298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p" event={"ID":"eff48b8e-5759-4724-a4f0-4c04ea994a90","Type":"ContainerStarted","Data":"a480b0d3ba814d40394a95d474f9b33afa1b63ec0921ec046c14c55ef0e0b820"}
Sep 15 11:45:08.642869 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:08.642829    2564 generic.go:356] "Generic (PLEG): container finished" podID="eff48b8e-5759-4724-a4f0-4c04ea994a90" containerID="a480b0d3ba814d40394a95d474f9b33afa1b63ec0921ec046c14c55ef0e0b820" exitCode=0
Sep 15 11:45:08.643280 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:08.642915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p" event={"ID":"eff48b8e-5759-4724-a4f0-4c04ea994a90","Type":"ContainerDied","Data":"a480b0d3ba814d40394a95d474f9b33afa1b63ec0921ec046c14c55ef0e0b820"}
Sep 15 11:45:09.173229 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:09.173188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:09.279627 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:09.279586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:09.649205 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:09.649170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p" event={"ID":"eff48b8e-5759-4724-a4f0-4c04ea994a90","Type":"ContainerStarted","Data":"2f0801009e6b803d03423b98818802ce597f521857180f67c99ccd5ef19d8fec"}
Sep 15 11:45:09.649609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:09.649254    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:09.672651 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:09.672604    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p" podStartSLOduration=2.180944752 podStartE2EDuration="6.67258962s" totalImagesPullingTime="3.413453527s" totalInitContainerRuntime="1.078191341s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:09.671371248 +0000 UTC m=+407.395113066" watchObservedRunningTime="2026-09-15 11:45:09.67258962 +0000 UTC m=+407.396331306"
Sep 15 11:45:15.354929 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:15.354899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:15.454734 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:15.454694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:19.774699 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:19.774665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:19.834658 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:19.834628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:20.657829 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:20.657795    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66bc7bc78c-qf58p"
Sep 15 11:45:22.298493 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:22.298459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:22.406740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:22.406704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:22.606833 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:22.606758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:22.764388 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:22.764357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:23.751792 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:23.751760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:23.815267 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:23.815233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:24.304428 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:24.304393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:24.369552 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:24.369515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:24.750314 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:24.750280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.423197 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.423163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.525411 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.525378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.660586 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.660551    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"]
Sep 15 11:45:28.665947 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.665924    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.668160 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.668133    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 11:45:28.668321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.668245    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-szvjj\""
Sep 15 11:45:28.675764 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.675702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"]
Sep 15 11:45:28.694332 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.694305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.764774 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.764733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.792607 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.792607 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.792816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792641    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.792816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.792816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.792949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tffzx\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-kube-api-access-tffzx\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.792949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.792949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.793050 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.792963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.865414 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.865379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:28.893395 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893508    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tffzx\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-kube-api-access-tffzx\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.893903 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893815    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.894146 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.893960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.894146 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.894005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.894146 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.894049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.894377 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.894206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.895855 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.895829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.896095 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.896073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.901026 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.901006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.901297 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.901278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tffzx\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-kube-api-access-tffzx\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcj855z\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:28.977189 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:28.977147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:29.252660 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:29.252455    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"]
Sep 15 11:45:29.255556 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:45:29.255525    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfe28c5_665e_4bca_ba2e_8c1f08fde247.slice/crio-039017628f1412d56abbca92b0938fd2c50ecde5e236f33f83bb64b5e69ef2f3 WatchSource:0}: Error finding container 039017628f1412d56abbca92b0938fd2c50ecde5e236f33f83bb64b5e69ef2f3: Status 404 returned error can't find the container with id 039017628f1412d56abbca92b0938fd2c50ecde5e236f33f83bb64b5e69ef2f3
Sep 15 11:45:29.744708 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:29.744676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z" event={"ID":"6cfe28c5-665e-4bca-ba2e-8c1f08fde247","Type":"ContainerStarted","Data":"039017628f1412d56abbca92b0938fd2c50ecde5e236f33f83bb64b5e69ef2f3"}
Sep 15 11:45:31.907344 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:31.907284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:32.039239 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:32.039184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:32.140112 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:32.140058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:32.645928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:32.645883    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:32.873004 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:32.872961    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:45:32.873086 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:32.873056    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:45:32.873126 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:32.873088    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:45:33.268592 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.268554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:33.340263 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.340204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:33.441848 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.441821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:33.767836 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.767799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z" event={"ID":"6cfe28c5-665e-4bca-ba2e-8c1f08fde247","Type":"ContainerStarted","Data":"250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747"}
Sep 15 11:45:33.780868 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.780842    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:33.790035 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.789984    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z" podStartSLOduration=2.1749718160000002 podStartE2EDuration="5.789965989s" totalImagesPullingTime="3.614994173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:33.789210353 +0000 UTC m=+431.512952040" watchObservedRunningTime="2026-09-15 11:45:33.789965989 +0000 UTC m=+431.513707675"
Sep 15 11:45:33.876158 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.876124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:33.977365 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.977331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:33.978549 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.978521    2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcj855z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Sep 15 11:45:33.978669 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:33.978583    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z" podUID="6cfe28c5-665e-4bca-ba2e-8c1f08fde247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Sep 15 11:45:34.226768 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:34.226727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:34.611401 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:34.611319    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"]
Sep 15 11:45:34.977646 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:34.977616    2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcj855z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Sep 15 11:45:34.977812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:34.977673    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z" podUID="6cfe28c5-665e-4bca-ba2e-8c1f08fde247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Sep 15 11:45:35.778041 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:35.778000    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z" podUID="6cfe28c5-665e-4bca-ba2e-8c1f08fde247" containerName="istio-proxy" containerID="cri-o://250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747" gracePeriod=30
Sep 15 11:45:38.203463 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:38.203421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:38.273310 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:38.273273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:40.602105 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.602072    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"]
Sep 15 11:45:40.610853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.610827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.613351 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.613315    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 11:45:40.613351 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.613343    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sd7pv\""
Sep 15 11:45:40.613619 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.613321    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 11:45:40.613619 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.613314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 11:45:40.621039 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.621018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"]
Sep 15 11:45:40.704691 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.704659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4bbl\" (UniqueName: \"kubernetes.io/projected/037fc2c2-c679-4009-9c54-cbda82768919-kube-api-access-f4bbl\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.704691 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.704697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.704958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.704736    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/037fc2c2-c679-4009-9c54-cbda82768919-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.704958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.704804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/037fc2c2-c679-4009-9c54-cbda82768919-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.704958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.704852    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037fc2c2-c679-4009-9c54-cbda82768919-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.704958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.704874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.704958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.704899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.806380 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.806338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.806518 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.806415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4bbl\" (UniqueName: \"kubernetes.io/projected/037fc2c2-c679-4009-9c54-cbda82768919-kube-api-access-f4bbl\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.806518 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.806445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.806518 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.806500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/037fc2c2-c679-4009-9c54-cbda82768919-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.806670 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.806578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/037fc2c2-c679-4009-9c54-cbda82768919-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.806670 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.806631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037fc2c2-c679-4009-9c54-cbda82768919-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.806670 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.806654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.807421 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.807389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/037fc2c2-c679-4009-9c54-cbda82768919-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.808768 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.808748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.808768 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.808766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/037fc2c2-c679-4009-9c54-cbda82768919-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.808935 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.808920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.808989 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.808974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/037fc2c2-c679-4009-9c54-cbda82768919-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.816176 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.816153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4bbl\" (UniqueName: \"kubernetes.io/projected/037fc2c2-c679-4009-9c54-cbda82768919-kube-api-access-f4bbl\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.819680 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.819658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037fc2c2-c679-4009-9c54-cbda82768919-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nfww7\" (UID: \"037fc2c2-c679-4009-9c54-cbda82768919\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:40.920971 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:40.920932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:41.039673 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.039648    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:41.109815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.109780    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istiod-ca-cert\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.109999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.109827    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-token\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.109999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.109850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-data\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.109999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.109887    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-certs\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.109999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.109946    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-envoy\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.109999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.109980    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-credential-socket\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.110275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110018    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-podinfo\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.110275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:41.110275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110075    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tffzx\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-kube-api-access-tffzx\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.110275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-socket\") pod \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\" (UID: \"6cfe28c5-665e-4bca-ba2e-8c1f08fde247\") "
Sep 15 11:45:41.110275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110185    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:41.110275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110201    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:45:41.110275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110253    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:41.110508 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110406    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.110508 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110419    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.110508 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110427    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.110508 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.110435    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.111464 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.111428    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:41.112449 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.112426    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:45:41.113016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.113001    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:41.113197 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.113173    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:45:41.113275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.113197    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-kube-api-access-tffzx" (OuterVolumeSpecName: "kube-api-access-tffzx") pod "6cfe28c5-665e-4bca-ba2e-8c1f08fde247" (UID: "6cfe28c5-665e-4bca-ba2e-8c1f08fde247"). InnerVolumeSpecName "kube-api-access-tffzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:41.195505 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.195474    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"]
Sep 15 11:45:41.195869 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.195857    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cfe28c5-665e-4bca-ba2e-8c1f08fde247" containerName="istio-proxy"
Sep 15 11:45:41.195917 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.195871    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cfe28c5-665e-4bca-ba2e-8c1f08fde247" containerName="istio-proxy"
Sep 15 11:45:41.195949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.195932    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cfe28c5-665e-4bca-ba2e-8c1f08fde247" containerName="istio-proxy"
Sep 15 11:45:41.199042 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.199021    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.206282 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.204643    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 11:45:41.206282 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.204889    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 11:45:41.206282 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.205048    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rhc28\""
Sep 15 11:45:41.206282 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.205199    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 11:45:41.209415 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.209389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"]
Sep 15 11:45:41.211460 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.211424    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.211460 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.211452    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tffzx\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-kube-api-access-tffzx\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.211637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.211467    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.211637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.211481    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.211637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.211494    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe28c5-665e-4bca-ba2e-8c1f08fde247-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:45:41.211637 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.211628    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"]
Sep 15 11:45:41.213199 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:45:41.213179    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037fc2c2_c679_4009_9c54_cbda82768919.slice/crio-56cf76533ddc6eb90f9aaa46c03a540b18f3b7333da0dba6ee5c0690cc3587c8 WatchSource:0}: Error finding container 56cf76533ddc6eb90f9aaa46c03a540b18f3b7333da0dba6ee5c0690cc3587c8: Status 404 returned error can't find the container with id 56cf76533ddc6eb90f9aaa46c03a540b18f3b7333da0dba6ee5c0690cc3587c8
Sep 15 11:45:41.312767 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.312734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6071821d-c73c-4a38-8c16-49c5cc143dec-manager-config\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.312916 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.312790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6071821d-c73c-4a38-8c16-49c5cc143dec-cert\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.312916 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.312861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6071821d-c73c-4a38-8c16-49c5cc143dec-metrics-cert\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.312916 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.312884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8hbt\" (UniqueName: \"kubernetes.io/projected/6071821d-c73c-4a38-8c16-49c5cc143dec-kube-api-access-n8hbt\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.413581 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.413548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6071821d-c73c-4a38-8c16-49c5cc143dec-manager-config\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.413744 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.413609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6071821d-c73c-4a38-8c16-49c5cc143dec-cert\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.413744 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.413663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6071821d-c73c-4a38-8c16-49c5cc143dec-metrics-cert\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.413744 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.413697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8hbt\" (UniqueName: \"kubernetes.io/projected/6071821d-c73c-4a38-8c16-49c5cc143dec-kube-api-access-n8hbt\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.414265 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.414239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6071821d-c73c-4a38-8c16-49c5cc143dec-manager-config\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.416122 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.416100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6071821d-c73c-4a38-8c16-49c5cc143dec-cert\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.416323 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.416304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6071821d-c73c-4a38-8c16-49c5cc143dec-metrics-cert\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.425033 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.425010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8hbt\" (UniqueName: \"kubernetes.io/projected/6071821d-c73c-4a38-8c16-49c5cc143dec-kube-api-access-n8hbt\") pod \"lws-controller-manager-c47996ddf-pw8gz\" (UID: \"6071821d-c73c-4a38-8c16-49c5cc143dec\") " pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.514737 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.514655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:41.799679 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.799647    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"]
Sep 15 11:45:41.800590 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:45:41.800559    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6071821d_c73c_4a38_8c16_49c5cc143dec.slice/crio-788d69cd77d0cd1257a14d9d84352a44a2940f01ece2e74ed8b7162fd32b915a WatchSource:0}: Error finding container 788d69cd77d0cd1257a14d9d84352a44a2940f01ece2e74ed8b7162fd32b915a: Status 404 returned error can't find the container with id 788d69cd77d0cd1257a14d9d84352a44a2940f01ece2e74ed8b7162fd32b915a
Sep 15 11:45:41.807184 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.807157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz" event={"ID":"6071821d-c73c-4a38-8c16-49c5cc143dec","Type":"ContainerStarted","Data":"788d69cd77d0cd1257a14d9d84352a44a2940f01ece2e74ed8b7162fd32b915a"}
Sep 15 11:45:41.808531 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.808500    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7" event={"ID":"037fc2c2-c679-4009-9c54-cbda82768919","Type":"ContainerStarted","Data":"56cf76533ddc6eb90f9aaa46c03a540b18f3b7333da0dba6ee5c0690cc3587c8"}
Sep 15 11:45:41.809963 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.809939    2564 generic.go:356] "Generic (PLEG): container finished" podID="6cfe28c5-665e-4bca-ba2e-8c1f08fde247" containerID="250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747" exitCode=0
Sep 15 11:45:41.810081 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.809997    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"
Sep 15 11:45:41.810081 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.810000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z" event={"ID":"6cfe28c5-665e-4bca-ba2e-8c1f08fde247","Type":"ContainerDied","Data":"250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747"}
Sep 15 11:45:41.810175 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.810124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z" event={"ID":"6cfe28c5-665e-4bca-ba2e-8c1f08fde247","Type":"ContainerDied","Data":"039017628f1412d56abbca92b0938fd2c50ecde5e236f33f83bb64b5e69ef2f3"}
Sep 15 11:45:41.810175 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.810156    2564 scope.go:117] "RemoveContainer" containerID="250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747"
Sep 15 11:45:41.818982 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.818966    2564 scope.go:117] "RemoveContainer" containerID="250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747"
Sep 15 11:45:41.819263 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:45:41.819240    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747\": container with ID starting with 250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747 not found: ID does not exist" containerID="250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747"
Sep 15 11:45:41.819350 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.819269    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747"} err="failed to get container status \"250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747\": rpc error: code = NotFound desc = could not find container \"250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747\": container with ID starting with 250d67f98fcb73ac11b748cc9a30bd69265c4dcf8cca59716b4b24cfeaa2e747 not found: ID does not exist"
Sep 15 11:45:41.839139 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.839114    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"]
Sep 15 11:45:41.843132 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:41.843112    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z"]
Sep 15 11:45:42.758367 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:42.758332    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cfe28c5-665e-4bca-ba2e-8c1f08fde247" path="/var/lib/kubelet/pods/6cfe28c5-665e-4bca-ba2e-8c1f08fde247/volumes"
Sep 15 11:45:42.822719 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:42.822684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:42.968492 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:42.968458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:43.075344 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:43.075186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:43.360802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:43.360615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:43.450743 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:43.450663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:43.709836 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:43.709801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:43.830815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:43.830781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:44.136398 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.136257    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:45:44.136398 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.136333    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:45:44.643629 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.643560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:44.749129 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.749085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:44.828238 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.828185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz" event={"ID":"6071821d-c73c-4a38-8c16-49c5cc143dec","Type":"ContainerStarted","Data":"00fcef1ad2d63b40d8bac48ffe9f437e1d7e04258445e6a70031e13fd2a616e1"}
Sep 15 11:45:44.828424 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.828275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:45:44.829792 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.829766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7" event={"ID":"037fc2c2-c679-4009-9c54-cbda82768919","Type":"ContainerStarted","Data":"e22a9f6a39fb619b0502cb237f62a89084fa4b6fbb6f37632f8cfd62a42b7d11"}
Sep 15 11:45:44.829901 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.829847    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:44.833671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.833645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:44.851953 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:44.851915    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz" podStartSLOduration=1.5173939920000001 podStartE2EDuration="3.851903615s" totalImagesPullingTime="2.334509623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:44.851084672 +0000 UTC m=+442.574826360" watchObservedRunningTime="2026-09-15 11:45:44.851903615 +0000 UTC m=+442.575645302"
Sep 15 11:45:45.836114 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:45.836041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7"
Sep 15 11:45:45.862316 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:45.862269    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7" podStartSLOduration=2.941814995 podStartE2EDuration="5.862253293s" totalImagesPullingTime="2.920438298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:44.906528658 +0000 UTC m=+442.630270344" watchObservedRunningTime="2026-09-15 11:45:45.862253293 +0000 UTC m=+443.585994977"
Sep 15 11:45:55.836666 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:45:55.836634    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c47996ddf-pw8gz"
Sep 15 11:46:20.323780 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:46:20.323748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:34.330491 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:46:34.330456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:34.430254 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:46:34.430201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:55.282480 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:46:55.282415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:56.070598 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:46:56.070561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:59.274317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:46:59.274274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:59.505231 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:46:59.505183    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:01.506837 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:01.506801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:01.715729 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:01.715680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:03.470890 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:03.470850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:03.872630 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:03.872546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:04.130078 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:04.129984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:04.270184 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:04.270143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:05.308938 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:05.308905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:05.415120 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:05.415083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:09.302978 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:09.302947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:09.401329 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:09.401300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:09.502954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:09.502927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:09.891475 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:09.891444    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:09.992061 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:09.992017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:13.299949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:13.299911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:13.393791 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:13.393757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:14.874603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:14.874570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:14.978750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:14.978714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:18.354744 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:18.354708    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:21.230778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:21.230735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:21.332300 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:21.332270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:25.246499 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:25.246452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:25.334545 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:25.334512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:29.064615 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:29.064552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:29.165502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:29.165450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:29.668267 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:29.668212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:29.768553 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:29.768520    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:33.075182 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:33.075145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:33.183977 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:33.183947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:35.491019 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:35.490988    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:35.588540 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:35.588506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:41.238923 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:41.238890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:41.324594 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:41.324561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:41.424203 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:41.424164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:56.872175 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:47:56.872141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:04.696152 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.696112    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"]
Sep 15 11:48:04.698478 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.698456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.700597 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.700574    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8hl22\""
Sep 15 11:48:04.709735 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.709712    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"]
Sep 15 11:48:04.730857 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.730829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:04.769571 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.769716 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769587    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpvcd\" (UniqueName: \"kubernetes.io/projected/02e96ae3-afac-46e8-960e-fecca7fa8236-kube-api-access-lpvcd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.769716 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.769716 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.769716 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.769881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.769881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.769881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.769985 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.769895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02e96ae3-afac-46e8-960e-fecca7fa8236-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870435 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870615 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870615 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870615 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870615 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870615 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02e96ae3-afac-46e8-960e-fecca7fa8236-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870893 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870893 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpvcd\" (UniqueName: \"kubernetes.io/projected/02e96ae3-afac-46e8-960e-fecca7fa8236-kube-api-access-lpvcd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.870893 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.871054 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.870917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.871054 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.871014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.871054 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.871039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.871193 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.871098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.871612 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.871595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02e96ae3-afac-46e8-960e-fecca7fa8236-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.872814 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.872794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.873077 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.873046    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.886068 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.886045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02e96ae3-afac-46e8-960e-fecca7fa8236-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.886434 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.886413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpvcd\" (UniqueName: \"kubernetes.io/projected/02e96ae3-afac-46e8-960e-fecca7fa8236-kube-api-access-lpvcd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cdq9w\" (UID: \"02e96ae3-afac-46e8-960e-fecca7fa8236\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:04.900954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:04.900926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:05.009820 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:05.009745    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:05.282950 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:05.282926    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"]
Sep 15 11:48:05.284944 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:48:05.284920    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e96ae3_afac_46e8_960e_fecca7fa8236.slice/crio-cc2105c2f8cebf6d950e6960355223ee937d764d0b884fd36ee94b739fd490c3 WatchSource:0}: Error finding container cc2105c2f8cebf6d950e6960355223ee937d764d0b884fd36ee94b739fd490c3: Status 404 returned error can't find the container with id cc2105c2f8cebf6d950e6960355223ee937d764d0b884fd36ee94b739fd490c3
Sep 15 11:48:05.287236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:05.287187    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:48:05.287294 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:05.287269    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:48:05.287334 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:05.287299    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:48:05.469192 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:05.469161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" event={"ID":"02e96ae3-afac-46e8-960e-fecca7fa8236","Type":"ContainerStarted","Data":"365b0a318c9c3e10e3e27cc2edcfb2aa1e71f28ee8d27faa2538905c9ef4a7ad"}
Sep 15 11:48:05.469382 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:05.469212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" event={"ID":"02e96ae3-afac-46e8-960e-fecca7fa8236","Type":"ContainerStarted","Data":"cc2105c2f8cebf6d950e6960355223ee937d764d0b884fd36ee94b739fd490c3"}
Sep 15 11:48:05.489852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:05.489810    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" podStartSLOduration=1.489795688 podStartE2EDuration="1.489795688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:05.488980062 +0000 UTC m=+583.212721747" watchObservedRunningTime="2026-09-15 11:48:05.489795688 +0000 UTC m=+583.213537374"
Sep 15 11:48:06.010456 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:06.010418    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:06.014609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:06.014585    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:06.473862 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:06.473835    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:06.474813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:06.474792    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:48:17.279635 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.279598    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:17.395934 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.395899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:17.496043 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.495991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:17.666827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.666562    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:48:17.669123 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.669103    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:17.671145 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.671126    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cvtsx\""
Sep 15 11:48:17.671271 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.671130    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 11:48:17.671271 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.671186    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 11:48:17.672186 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.672169    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 11:48:17.678379 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.678360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:48:17.689438 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.689416    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:48:17.786802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.786773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92dc2db0-48d1-4aa1-a905-b8d82fa7c60e-config-file\") pod \"limitador-limitador-84994f7ffc-fx8lm\" (UID: \"92dc2db0-48d1-4aa1-a905-b8d82fa7c60e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:17.786945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.786831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269w5\" (UniqueName: \"kubernetes.io/projected/92dc2db0-48d1-4aa1-a905-b8d82fa7c60e-kube-api-access-269w5\") pod \"limitador-limitador-84994f7ffc-fx8lm\" (UID: \"92dc2db0-48d1-4aa1-a905-b8d82fa7c60e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:17.888169 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.888141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-269w5\" (UniqueName: \"kubernetes.io/projected/92dc2db0-48d1-4aa1-a905-b8d82fa7c60e-kube-api-access-269w5\") pod \"limitador-limitador-84994f7ffc-fx8lm\" (UID: \"92dc2db0-48d1-4aa1-a905-b8d82fa7c60e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:17.888403 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.888382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92dc2db0-48d1-4aa1-a905-b8d82fa7c60e-config-file\") pod \"limitador-limitador-84994f7ffc-fx8lm\" (UID: \"92dc2db0-48d1-4aa1-a905-b8d82fa7c60e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:17.888995 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.888972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92dc2db0-48d1-4aa1-a905-b8d82fa7c60e-config-file\") pod \"limitador-limitador-84994f7ffc-fx8lm\" (UID: \"92dc2db0-48d1-4aa1-a905-b8d82fa7c60e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:17.896585 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.896565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-269w5\" (UniqueName: \"kubernetes.io/projected/92dc2db0-48d1-4aa1-a905-b8d82fa7c60e-kube-api-access-269w5\") pod \"limitador-limitador-84994f7ffc-fx8lm\" (UID: \"92dc2db0-48d1-4aa1-a905-b8d82fa7c60e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:17.980126 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:17.980100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:18.104055 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:18.104010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:18.203000 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:18.202961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:18.248259 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:18.248236    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:48:18.250157 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:48:18.250126    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92dc2db0_48d1_4aa1_a905_b8d82fa7c60e.slice/crio-beba0277e0d1df5c5de5f5f4cd7583986e74557b5581f3d509fdb0c39c78d23e WatchSource:0}: Error finding container beba0277e0d1df5c5de5f5f4cd7583986e74557b5581f3d509fdb0c39c78d23e: Status 404 returned error can't find the container with id beba0277e0d1df5c5de5f5f4cd7583986e74557b5581f3d509fdb0c39c78d23e
Sep 15 11:48:18.305964 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:18.305929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:18.537350 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:18.537263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm" event={"ID":"92dc2db0-48d1-4aa1-a905-b8d82fa7c60e","Type":"ContainerStarted","Data":"beba0277e0d1df5c5de5f5f4cd7583986e74557b5581f3d509fdb0c39c78d23e"}
Sep 15 11:48:20.550594 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:20.550544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm" event={"ID":"92dc2db0-48d1-4aa1-a905-b8d82fa7c60e","Type":"ContainerStarted","Data":"fcd3aeb792a2233d33967f58214cf8630d79cefc0c23025ca5e4dfeb15176d6c"}
Sep 15 11:48:20.550954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:20.550619    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:20.568347 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:20.568300    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm" podStartSLOduration=1.48287885 podStartE2EDuration="3.568285277s" totalImagesPullingTime="2.085406427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:20.566994227 +0000 UTC m=+598.290735914" watchObservedRunningTime="2026-09-15 11:48:20.568285277 +0000 UTC m=+598.292026964"
Sep 15 11:48:31.557084 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:31.557056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"
Sep 15 11:48:32.808478 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:32.808435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:32.908713 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:32.908682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:33.309286 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:33.309248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:36.377638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:36.377610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:36.481112 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:36.481087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:42.958863 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:42.958828    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:43.216153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:43.216073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:49.635090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:49.635006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:49.734077 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:49.734045    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:49.834613 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:49.834580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:53.075360 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:53.075315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:53.181532 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:48:53.181490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:25.700307 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:25.700270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:27.110798 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:27.110766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:27.211455 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:27.211421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:27.310780 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:27.310746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:27.384246 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:27.384139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:27.752881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:27.752833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:27.857892 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:27.857862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:28.046815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:28.046738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:49:37.071406 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.070773    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cdq9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": read tcp 10.132.0.2:50070->10.132.0.30:15021: read: connection reset by peer" start-of-body=
Sep 15 11:49:37.071406 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.070849    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" podUID="02e96ae3-afac-46e8-960e-fecca7fa8236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": read tcp 10.132.0.2:50070->10.132.0.30:15021: read: connection reset by peer"
Sep 15 11:49:37.908277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.908235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:37.918663 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.918636    2564 generic.go:356] "Generic (PLEG): container finished" podID="02e96ae3-afac-46e8-960e-fecca7fa8236" containerID="365b0a318c9c3e10e3e27cc2edcfb2aa1e71f28ee8d27faa2538905c9ef4a7ad" exitCode=0
Sep 15 11:49:37.918794 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.918718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" event={"ID":"02e96ae3-afac-46e8-960e-fecca7fa8236","Type":"ContainerDied","Data":"365b0a318c9c3e10e3e27cc2edcfb2aa1e71f28ee8d27faa2538905c9ef4a7ad"}
Sep 15 11:49:37.919119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.919105    2564 scope.go:117] "RemoveContainer" containerID="365b0a318c9c3e10e3e27cc2edcfb2aa1e71f28ee8d27faa2538905c9ef4a7ad"
Sep 15 11:49:37.920136 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.920111    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:49:37.920194 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.920176    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:49:37.920254 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:37.920212    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:49:38.004740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:38.004660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:38.924904 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:38.924872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" event={"ID":"02e96ae3-afac-46e8-960e-fecca7fa8236","Type":"ContainerStarted","Data":"2f31908dbaf009fa48494b9f24377f8e586049813be68c8c418288dcaf89ce1c"}
Sep 15 11:49:39.010416 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:39.010384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:49:39.010680 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:39.010658    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cdq9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 11:49:39.010766 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:39.010711    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" podUID="02e96ae3-afac-46e8-960e-fecca7fa8236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 11:49:40.010720 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:40.010687    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cdq9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 11:49:40.011071 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:40.010749    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" podUID="02e96ae3-afac-46e8-960e-fecca7fa8236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 11:49:41.010707 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:41.010670    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cdq9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 11:49:41.010891 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:41.010723    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" podUID="02e96ae3-afac-46e8-960e-fecca7fa8236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 11:49:42.010478 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:42.010437    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cdq9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 11:49:42.010657 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:42.010498    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" podUID="02e96ae3-afac-46e8-960e-fecca7fa8236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 11:49:43.010551 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:43.010519    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cdq9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 11:49:43.011007 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:43.010595    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w" podUID="02e96ae3-afac-46e8-960e-fecca7fa8236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 11:49:43.492073 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:43.492031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:44.013178 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:44.013148    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:49:44.013588 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:44.013409    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:49:44.014011 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:44.013994    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w"
Sep 15 11:49:44.162410 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:44.162380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:49:46.925044 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:49:46.925013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:04.664096 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.664059    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"]
Sep 15 11:50:04.667845 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.667822    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.670044 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.670022    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 11:50:04.670993 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.670975    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 11:50:04.671081 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.670996    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 15 11:50:04.671081 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.670996    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wkm2k\""
Sep 15 11:50:04.678013 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.677994    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"]
Sep 15 11:50:04.689802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.689779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:04.832513 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.832480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.832710 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.832524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.832710 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.832640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.832710 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.832693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.832907 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.832714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbq5z\" (UniqueName: \"kubernetes.io/projected/124e6d01-939c-4a74-9719-17444a7a1616-kube-api-access-kbq5z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.832907 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.832785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/124e6d01-939c-4a74-9719-17444a7a1616-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.933852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.933758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.933852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.933810    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.933852 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.933838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.934103 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.933886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.934103 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.933907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbq5z\" (UniqueName: \"kubernetes.io/projected/124e6d01-939c-4a74-9719-17444a7a1616-kube-api-access-kbq5z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.934103 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.933946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/124e6d01-939c-4a74-9719-17444a7a1616-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.934249 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.934210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.934326 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.934305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.934369 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.934332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.936104 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.936078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/124e6d01-939c-4a74-9719-17444a7a1616-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.936444 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.936425    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/124e6d01-939c-4a74-9719-17444a7a1616-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.942610 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.942588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbq5z\" (UniqueName: \"kubernetes.io/projected/124e6d01-939c-4a74-9719-17444a7a1616-kube-api-access-kbq5z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-74ncb\" (UID: \"124e6d01-939c-4a74-9719-17444a7a1616\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:04.978696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:04.978669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:05.252123 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:05.252089    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"]
Sep 15 11:50:05.255715 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:50:05.255687    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124e6d01_939c_4a74_9719_17444a7a1616.slice/crio-95c1854b055964d09471243f055616377b7c458d0c80f2805bde8609339f08be WatchSource:0}: Error finding container 95c1854b055964d09471243f055616377b7c458d0c80f2805bde8609339f08be: Status 404 returned error can't find the container with id 95c1854b055964d09471243f055616377b7c458d0c80f2805bde8609339f08be
Sep 15 11:50:05.257134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:05.257118    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:50:05.354344 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:05.354312    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:50:06.059587 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:06.059552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb" event={"ID":"124e6d01-939c-4a74-9719-17444a7a1616","Type":"ContainerStarted","Data":"95c1854b055964d09471243f055616377b7c458d0c80f2805bde8609339f08be"}
Sep 15 11:50:06.914271 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:06.914236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:06.975469 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:06.975399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:07.065411 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:07.065375    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb" event={"ID":"124e6d01-939c-4a74-9719-17444a7a1616","Type":"ContainerStarted","Data":"6be17a93b96d0dee97046329dd16be25387db86389097bb3dc338aec7d3e5bd7"}
Sep 15 11:50:07.086263 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:07.086189    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb" podStartSLOduration=2.076980534 podStartE2EDuration="3.086171908s" totalImagesPullingTime="1.009191374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:07.084518834 +0000 UTC m=+704.808260523" watchObservedRunningTime="2026-09-15 11:50:07.086171908 +0000 UTC m=+704.809913593"
Sep 15 11:50:14.979745 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:14.979702    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:14.980137 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:14.979776    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:14.992612 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:14.992584    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:15.115698 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:15.115625    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-74ncb"
Sep 15 11:50:16.195831 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:16.195798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:17.175968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:17.175939    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:50:27.749593 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.749561    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"]
Sep 15 11:50:27.753619 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.753593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.756009 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.755986    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 15 11:50:27.765394 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.765372    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"]
Sep 15 11:50:27.794983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.794941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:27.850455 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.850427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.850601 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.850459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.850601 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.850477    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.850601 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.850492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.850707 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.850630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sv9g\" (UniqueName: \"kubernetes.io/projected/9a637429-1a98-4481-a39e-974ca7da54cd-kube-api-access-8sv9g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.850707 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.850662    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a637429-1a98-4481-a39e-974ca7da54cd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952467 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952467 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952467 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952467 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv9g\" (UniqueName: \"kubernetes.io/projected/9a637429-1a98-4481-a39e-974ca7da54cd-kube-api-access-8sv9g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952467 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a637429-1a98-4481-a39e-974ca7da54cd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952733 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952708    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952798 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.952798 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.952784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.954563 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.954542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a637429-1a98-4481-a39e-974ca7da54cd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.954863 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.954847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a637429-1a98-4481-a39e-974ca7da54cd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:27.960999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:27.960978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sv9g\" (UniqueName: \"kubernetes.io/projected/9a637429-1a98-4481-a39e-974ca7da54cd-kube-api-access-8sv9g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dwpsj\" (UID: \"9a637429-1a98-4481-a39e-974ca7da54cd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:28.065060 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:28.064963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:28.337343 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:28.337269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"]
Sep 15 11:50:28.340679 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:50:28.340649    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a637429_1a98_4481_a39e_974ca7da54cd.slice/crio-33c686bddbd65aaa7336fff572de193b2d0483fc2401bf9528ec166bc182213d WatchSource:0}: Error finding container 33c686bddbd65aaa7336fff572de193b2d0483fc2401bf9528ec166bc182213d: Status 404 returned error can't find the container with id 33c686bddbd65aaa7336fff572de193b2d0483fc2401bf9528ec166bc182213d
Sep 15 11:50:28.958694 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:28.958656    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:50:29.176730 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:29.176694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj" event={"ID":"9a637429-1a98-4481-a39e-974ca7da54cd","Type":"ContainerStarted","Data":"cf18f8566d083a06351d92156d84e0f72535c1d3b18db23102227556cf9092b6"}
Sep 15 11:50:29.176923 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:29.176754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj" event={"ID":"9a637429-1a98-4481-a39e-974ca7da54cd","Type":"ContainerStarted","Data":"33c686bddbd65aaa7336fff572de193b2d0483fc2401bf9528ec166bc182213d"}
Sep 15 11:50:29.195878 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:29.195827    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj" podStartSLOduration=1.9608192629999999 podStartE2EDuration="2.195806582s" totalImagesPullingTime="234.987319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:29.195131353 +0000 UTC m=+726.918873031" watchObservedRunningTime="2026-09-15 11:50:29.195806582 +0000 UTC m=+726.919548266"
Sep 15 11:50:30.761285 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.761255    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"]
Sep 15 11:50:30.764946 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.764924    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.767520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.767500    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 15 11:50:30.774602 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.774583    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"]
Sep 15 11:50:30.882995 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.882949    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tbt\" (UniqueName: \"kubernetes.io/projected/45d916cb-94b3-4fd8-9c1d-ecad4768a196-kube-api-access-84tbt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.883162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.883030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.883162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.883067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.883162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.883097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45d916cb-94b3-4fd8-9c1d-ecad4768a196-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.883162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.883125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.883446 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.883214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.895609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.895578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:30.984756 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.984722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84tbt\" (UniqueName: \"kubernetes.io/projected/45d916cb-94b3-4fd8-9c1d-ecad4768a196-kube-api-access-84tbt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.984949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.984778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.984949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.984814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.984949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.984840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45d916cb-94b3-4fd8-9c1d-ecad4768a196-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.984949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.984868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.984949 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.984923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.985246 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.985201    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.985246 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.985243    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.985369 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.985306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.987131 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.987106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45d916cb-94b3-4fd8-9c1d-ecad4768a196-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.987272 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.987254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45d916cb-94b3-4fd8-9c1d-ecad4768a196-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:30.997826 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:30.997802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tbt\" (UniqueName: \"kubernetes.io/projected/45d916cb-94b3-4fd8-9c1d-ecad4768a196-kube-api-access-84tbt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj\" (UID: \"45d916cb-94b3-4fd8-9c1d-ecad4768a196\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:31.077058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:31.076963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:31.352481 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:31.352419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"]
Sep 15 11:50:31.354694 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:50:31.354663    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d916cb_94b3_4fd8_9c1d_ecad4768a196.slice/crio-2a5d8e15a770902880176bd20976adc994d5f9df3400ce972d21a33c2da2c829 WatchSource:0}: Error finding container 2a5d8e15a770902880176bd20976adc994d5f9df3400ce972d21a33c2da2c829: Status 404 returned error can't find the container with id 2a5d8e15a770902880176bd20976adc994d5f9df3400ce972d21a33c2da2c829
Sep 15 11:50:32.193057 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:32.193021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj" event={"ID":"45d916cb-94b3-4fd8-9c1d-ecad4768a196","Type":"ContainerStarted","Data":"1fa0d89b23f98c97fb589b5a58f6a48a8933cd28f9bfc948e163e3d2a09700a1"}
Sep 15 11:50:32.193455 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:32.193077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj" event={"ID":"45d916cb-94b3-4fd8-9c1d-ecad4768a196","Type":"ContainerStarted","Data":"2a5d8e15a770902880176bd20976adc994d5f9df3400ce972d21a33c2da2c829"}
Sep 15 11:50:32.215135 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:32.215083    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj" podStartSLOduration=2.012150155 podStartE2EDuration="2.21506551s" totalImagesPullingTime="202.915355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:32.212527858 +0000 UTC m=+729.936269557" watchObservedRunningTime="2026-09-15 11:50:32.21506551 +0000 UTC m=+729.938807196"
Sep 15 11:50:35.451813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:35.451782    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:50:38.065826 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:38.065794    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:38.066257 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:38.066079    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:38.078574 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:38.078554    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:38.235172 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:38.235145    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dwpsj"
Sep 15 11:50:41.077454 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:41.077421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:41.077884 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:41.077482    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:41.089635 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:41.089613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:41.256090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:41.256064    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj"
Sep 15 11:50:54.766396 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:54.766358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:56.454422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:50:56.454388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:51:08.083435 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:51:08.083396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:10.261075 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:51:10.261035    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:52:29.230848 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:29.230814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:29.319254 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:29.319202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:30.427937 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:30.427903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:30.522923 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:30.522876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:48.541958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:48.541925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:48.675617 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:48.675587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:48.774581 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:48.774545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:48.973735 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:48.973704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:49.018443 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.018413    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"]
Sep 15 11:52:49.021964 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.021947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.026279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.026248    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-ac76e5-openshift-default-dockercfg-kb42g\""
Sep 15 11:52:49.048914 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.048876    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"]
Sep 15 11:52:49.071538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.071504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:49.111815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.111778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gngqj\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-kube-api-access-gngqj\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.111815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.111816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-socket\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.112025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.111840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-credential-socket\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.112025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.111899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-token\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.112163 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.112035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-certs\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.112163 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.112083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-envoy\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.112163 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.112112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-podinfo\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.112333 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.112177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-data\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.112333 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.112289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istiod-ca-cert\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.118671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.118642    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"]
Sep 15 11:52:49.122086 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.122072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.125339 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.125316    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-97d02d-openshift-default-dockercfg-8xmvm\""
Sep 15 11:52:49.141907 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.141880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"]
Sep 15 11:52:49.161234 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.161202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:49.216253 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.216186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-data\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.216441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.216266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-socket\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.216441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.216312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istiod-ca-cert\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.216803 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.216778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-certs\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217029 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-envoy\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217206 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-podinfo\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217331 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-data\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217331 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istiod-ca-cert\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217331 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-certs\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217509 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2snc\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-kube-api-access-r2snc\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.217509 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-credential-socket\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.217509 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-envoy\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.217509 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-token\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.217509 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gngqj\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-kube-api-access-gngqj\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-socket\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-credential-socket\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-token\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-data\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.217778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-podinfo\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.217778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-certs\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.218048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.217833    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-credential-socket\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.218144 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.218120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-socket\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.218635 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.218581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istiod-ca-cert\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.219442 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.219423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-envoy\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.219769 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.219751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-podinfo\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.231431 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.231365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gngqj\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-kube-api-access-gngqj\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.231431 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.231400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-token\") pod \"e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") " pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.267159 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.267129    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:49.318844 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.318812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2snc\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-kube-api-access-r2snc\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.318844 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.318845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-credential-socket\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319091 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.318861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-envoy\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319091 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.318886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-token\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319091 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.318918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-podinfo\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319091 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.318944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-certs\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319091 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.318975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-data\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319091 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.319001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-socket\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319091 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.319036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istiod-ca-cert\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319535 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.319418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-data\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319535 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.319481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-certs\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319535 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.319523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-credential-socket\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319664 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.319538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-socket\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.319876 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.319858    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istiod-ca-cert\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.321415 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.321393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-envoy\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.321542 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.321527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-podinfo\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.332316 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.332296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2snc\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-kube-api-access-r2snc\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.332484 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.332472    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:49.333030 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.333009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-token\") pod \"e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") " pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.363994 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.363964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:49.432274 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.432246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:49.527636 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.527601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:49.629901 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:52:49.629870    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff45e062_f6da_46a3_a6e6_fff4ddf7f46e.slice/crio-95d0b2a89f5587a54eb4659da7dc63f7c6257f5dcd443989e9d6d81356aef2a8 WatchSource:0}: Error finding container 95d0b2a89f5587a54eb4659da7dc63f7c6257f5dcd443989e9d6d81356aef2a8: Status 404 returned error can't find the container with id 95d0b2a89f5587a54eb4659da7dc63f7c6257f5dcd443989e9d6d81356aef2a8
Sep 15 11:52:49.632119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.632088    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:52:49.632206 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.632152    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:52:49.632206 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.632182    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:52:49.637330 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.637281    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"]
Sep 15 11:52:49.786608 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.786576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"]
Sep 15 11:52:49.795915 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.795871    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:52:49.796037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.795956    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:52:49.796037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.795988    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:52:49.855269 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.855238    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" event={"ID":"d71e7a3c-b537-4d18-83d9-19e1109ffc4e","Type":"ContainerStarted","Data":"c31fd661e0d6d1dccfc9a8fb1e31da494ccfb217dc80468a2f3e89ecdf2a4ef2"}
Sep 15 11:52:49.857036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.857004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" event={"ID":"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e","Type":"ContainerStarted","Data":"3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62"}
Sep 15 11:52:49.857144 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.857067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" event={"ID":"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e","Type":"ContainerStarted","Data":"95d0b2a89f5587a54eb4659da7dc63f7c6257f5dcd443989e9d6d81356aef2a8"}
Sep 15 11:52:49.890669 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:49.890622    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podStartSLOduration=1.8906066259999998 podStartE2EDuration="1.890606626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:52:49.887937655 +0000 UTC m=+867.611679341" watchObservedRunningTime="2026-09-15 11:52:49.890606626 +0000 UTC m=+867.614348313"
Sep 15 11:52:50.068578 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.068496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:50.167654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.167619    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:50.333038 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.332948    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:50.338145 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.338122    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:50.601312 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.601208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:50.863239 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.863126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" event={"ID":"d71e7a3c-b537-4d18-83d9-19e1109ffc4e","Type":"ContainerStarted","Data":"8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1"}
Sep 15 11:52:50.863670 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.863456    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:50.864384 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.864363    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:52:50.901663 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:50.901617    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" podStartSLOduration=1.901601103 podStartE2EDuration="1.901601103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:52:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:52:50.900810814 +0000 UTC m=+868.624552504" watchObservedRunningTime="2026-09-15 11:52:50.901601103 +0000 UTC m=+868.625342789"
Sep 15 11:52:51.432932 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:51.432896    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:51.438192 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:51.438166    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:51.868585 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:51.868551    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:51.869450 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:51.869432    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:52:52.024131 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:52.024096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:52.170422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:52.170341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:52.254088 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:52.254061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:52.403753 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:52.403716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:52.505015 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:52.504984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:52.593277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:52.593246    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:52:53.032354 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:53.032319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:53.167229 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:53.167185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:54.300549 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:54.300512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:54.401510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:54.401477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:54.714530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:54.714501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:55.109625 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:55.109516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:55.199861 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:55.199828    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:55.928376 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:55.928335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:56.014663 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:56.014628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:56.285743 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:56.285709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:56.653931 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:56.653854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:56.783971 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:56.783935    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:57.253358 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:57.253320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:57.467402 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:57.467361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:57.582394 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:57.582290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:57.697668 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:57.697638    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:57.863777 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:57.863689    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:58.477283 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:58.477237    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:58.603779 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:58.603744    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:59.333865 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:52:59.333829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:00.648783 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:00.648699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:01.059825 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:01.059798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:01.158663 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:01.158630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:01.252128 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:01.252095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:01.357993 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:01.357902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:01.507480 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:01.507435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:02.020132 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.020101    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"]
Sep 15 11:53:02.025032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.025011    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.032004 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.031980    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-814e2181-openshift-default-dockercfg-f4xvr\""
Sep 15 11:53:02.064320 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.064282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"]
Sep 15 11:53:02.154850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.154814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-token\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.154850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.154851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d716e70e-417d-47e9-b112-9ba03d31ed61-istiod-ca-cert\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.155064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.154874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d24sm\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-kube-api-access-d24sm\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.155064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.154993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-socket\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.155064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.155014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-certs\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.155186 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.155158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-envoy\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.155251 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.155234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-podinfo\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.155292 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.155268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-credential-socket\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.155324 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.155307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-data\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.162551 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.162517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:02.257420 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.256888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-socket\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.257707 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.257387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-socket\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.257843 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.257824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-certs\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.258053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.258036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-envoy\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.258240 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.258117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-certs\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.258363 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.258197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-podinfo\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.258481 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.258465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-credential-socket\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.258902 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.258884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-data\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.259047 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.259032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-token\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.259153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.259140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d716e70e-417d-47e9-b112-9ba03d31ed61-istiod-ca-cert\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.259280 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.259265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d24sm\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-kube-api-access-d24sm\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.259940 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.259653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-data\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.259940 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.258817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-credential-socket\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.260380 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.260356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d716e70e-417d-47e9-b112-9ba03d31ed61-istiod-ca-cert\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.260970 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.260935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-envoy\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.263208 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.263167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-podinfo\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.275838 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.275729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d24sm\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-kube-api-access-d24sm\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.277022 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.276984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:02.278980 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.278956    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-token\") pod \"e2e-ait-814e2181-openshift-default-79874bf8f6-swn74\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") " pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.335805 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.335765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:02.666644 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.664245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"]
Sep 15 11:53:02.666990 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:53:02.666952    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd716e70e_417d_47e9_b112_9ba03d31ed61.slice/crio-787071c63bd8a291fe8255e2ba831eb5447cd9c424dd89a5143d86a557bb35bb WatchSource:0}: Error finding container 787071c63bd8a291fe8255e2ba831eb5447cd9c424dd89a5143d86a557bb35bb: Status 404 returned error can't find the container with id 787071c63bd8a291fe8255e2ba831eb5447cd9c424dd89a5143d86a557bb35bb
Sep 15 11:53:02.670124 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.670075    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:02.670252 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.670175    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:02.670317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.670260    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:02.932853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.932757    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" event={"ID":"d716e70e-417d-47e9-b112-9ba03d31ed61","Type":"ContainerStarted","Data":"e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337"}
Sep 15 11:53:02.932853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:02.932815    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" event={"ID":"d716e70e-417d-47e9-b112-9ba03d31ed61","Type":"ContainerStarted","Data":"787071c63bd8a291fe8255e2ba831eb5447cd9c424dd89a5143d86a557bb35bb"}
Sep 15 11:53:03.336682 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:03.336640    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:03.341844 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:03.341820    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:03.369281 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:03.366650    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" podStartSLOduration=2.36662801 podStartE2EDuration="2.36662801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:02.971263702 +0000 UTC m=+880.695005389" watchObservedRunningTime="2026-09-15 11:53:03.36662801 +0000 UTC m=+881.090369701"
Sep 15 11:53:03.620341 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:03.620248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:03.938616 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:03.938561    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:03.940195 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:03.940173    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:04.380793 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:04.380705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:04.705411 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:04.705377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:04.795397 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:04.795364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:05.267533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:05.267487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:05.372113 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:05.372081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:05.529252 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:05.529158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:05.640723 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:05.640689    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:05.818738 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:05.818651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:05.960463 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:05.960436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:06.378891 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:06.378851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:07.342024 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:07.341988    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:08.471972 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:08.471937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:08.573082 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:08.573052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:08.674715 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:08.674679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:09.001691 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:09.001655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:09.098439 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:09.098402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:09.445801 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:09.445767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:10.173340 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:10.173302    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:53:10.492813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:10.492773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:11.682784 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.682758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:11.794391 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.794357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:11.911021 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.910900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:11.995854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.995817    2564 generic.go:356] "Generic (PLEG): container finished" podID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerID="8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1" exitCode=0
Sep 15 11:53:11.996053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.995902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" event={"ID":"d71e7a3c-b537-4d18-83d9-19e1109ffc4e","Type":"ContainerDied","Data":"8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1"}
Sep 15 11:53:11.996437 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.996415    2564 scope.go:117] "RemoveContainer" containerID="8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1"
Sep 15 11:53:11.997905 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.997835    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:11.998003 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.997933    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:11.998003 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.997984    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:11.998003 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.997988    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerID="3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62" exitCode=0
Sep 15 11:53:11.998177 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.998066    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" event={"ID":"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e","Type":"ContainerDied","Data":"3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62"}
Sep 15 11:53:11.998463 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.998446    2564 scope.go:117] "RemoveContainer" containerID="3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62"
Sep 15 11:53:12.000339 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.999817    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:12.000339 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.999895    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:12.000339 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:11.999946    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:12.281267 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:12.281210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:12.385921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:12.385887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:12.474054 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:12.474018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:12.580042 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:12.579952    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:12.686888 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:12.686848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:12.786266 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:12.786239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:12.897864 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:12.897778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:13.001966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.001927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:13.005808 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.005785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" event={"ID":"d71e7a3c-b537-4d18-83d9-19e1109ffc4e","Type":"ContainerStarted","Data":"39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498"}
Sep 15 11:53:13.007803 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.007779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" event={"ID":"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e","Type":"ContainerStarted","Data":"282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36"}
Sep 15 11:53:13.189841 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.189810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:13.333299 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.333267    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:53:13.333527 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.333506    2564 patch_prober.go:28] interesting pod/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 15 11:53:13.333583 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.333564    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 15 11:53:13.432761 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.432719    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:53:13.432963 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.432925    2564 patch_prober.go:28] interesting pod/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:53:13.433041 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.432981    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 15 11:53:13.501295 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.501202    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"]
Sep 15 11:53:13.504793 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.504772    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.508077 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.508049    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e9bc87-openshift-default-dockercfg-gdpnc\""
Sep 15 11:53:13.525058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.525034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"]
Sep 15 11:53:13.564899 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.564867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:13.600477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-podinfo\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.600477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-credential-socket\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.600732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600519    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-envoy\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.600732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a09514-b3a1-4dc8-b788-fab03de797c3-istiod-ca-cert\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.600732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5zm7\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-kube-api-access-d5zm7\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.600732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-data\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.600732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-token\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.600732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-certs\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.600732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.600727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-socket\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.668786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.668750    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:13.701681 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.701646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-envoy\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.701687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a09514-b3a1-4dc8-b788-fab03de797c3-istiod-ca-cert\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.701813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5zm7\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-kube-api-access-d5zm7\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.701851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-data\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.701881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-token\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.701935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-certs\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.701956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-socket\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.702091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-podinfo\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.702127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-credential-socket\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.702147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-data\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.702322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-certs\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.702429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-socket\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.702572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-credential-socket\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.702862 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.702843    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a09514-b3a1-4dc8-b788-fab03de797c3-istiod-ca-cert\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.704045 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.704023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-envoy\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.704475 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.704458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-podinfo\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.711854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.711826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5zm7\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-kube-api-access-d5zm7\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.713526 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.713503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-token\") pod \"e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") " pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:13.769066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.768793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:13.815821 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:13.815781    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:14.123914 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.123890    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"]
Sep 15 11:53:14.125776 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:53:14.125737    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a09514_b3a1_4dc8_b788_fab03de797c3.slice/crio-0c1dc33359eb6faa5e743db26cdd3712260d04e69dddb89fffb1eff654c74089 WatchSource:0}: Error finding container 0c1dc33359eb6faa5e743db26cdd3712260d04e69dddb89fffb1eff654c74089: Status 404 returned error can't find the container with id 0c1dc33359eb6faa5e743db26cdd3712260d04e69dddb89fffb1eff654c74089
Sep 15 11:53:14.128077 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.128040    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:14.128131 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.128107    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:14.128178 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.128152    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:14.333409 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.333364    2564 patch_prober.go:28] interesting pod/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 15 11:53:14.333609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.333422    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 15 11:53:14.432771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.432684    2564 patch_prober.go:28] interesting pod/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:53:14.432771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.432740    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 15 11:53:14.640710 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.640674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:14.761006 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.760966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:14.856117 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.856079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:14.981622 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:14.981587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:15.020192 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.020097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" event={"ID":"b4a09514-b3a1-4dc8-b788-fab03de797c3","Type":"ContainerStarted","Data":"8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d"}
Sep 15 11:53:15.020192 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.020153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" event={"ID":"b4a09514-b3a1-4dc8-b788-fab03de797c3","Type":"ContainerStarted","Data":"0c1dc33359eb6faa5e743db26cdd3712260d04e69dddb89fffb1eff654c74089"}
Sep 15 11:53:15.043983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.043940    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podStartSLOduration=2.043919034 podStartE2EDuration="2.043919034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:15.04247955 +0000 UTC m=+892.766221267" watchObservedRunningTime="2026-09-15 11:53:15.043919034 +0000 UTC m=+892.767660798"
Sep 15 11:53:15.333557 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.333454    2564 patch_prober.go:28] interesting pod/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 15 11:53:15.333764 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.333741    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 15 11:53:15.433394 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.433356    2564 patch_prober.go:28] interesting pod/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:53:15.433576 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.433414    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 15 11:53:15.559070 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.559027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:15.697229 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.697179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:15.817120 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.817075    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:15.825503 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:15.825475    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:16.025744 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:16.025649    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:16.026778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:16.026758    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:16.337253 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:16.337128    2564 patch_prober.go:28] interesting pod/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 15 11:53:16.337515 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:16.337483    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 15 11:53:16.433054 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:16.433011    2564 patch_prober.go:28] interesting pod/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:53:16.433210 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:16.433077    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 15 11:53:16.757914 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:16.757869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:17.090343 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:17.090240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:17.228134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:17.228102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:17.333409 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:17.333378    2564 patch_prober.go:28] interesting pod/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 15 11:53:17.333642 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:17.333616    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 15 11:53:17.433435 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:17.433324    2564 patch_prober.go:28] interesting pod/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:53:17.433435 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:17.433390    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 15 11:53:18.333320 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:18.333283    2564 patch_prober.go:28] interesting pod/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 15 11:53:18.333841 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:18.333345    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 15 11:53:18.339094 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:18.339052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:18.512440 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:18.512407    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:53:18.513315 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:18.513282    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:53:18.514617 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:18.514597    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 11:53:19.333170 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:19.333140    2564 patch_prober.go:28] interesting pod/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 15 11:53:19.333368 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:19.333193    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 15 11:53:19.559455 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:19.559418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:20.337446 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.337417    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:53:20.337810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.337719    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:53:20.338503 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.338487    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 11:53:20.478787 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.478760    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"]
Sep 15 11:53:20.481766 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.481747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.484597 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.484553    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:53:20.484597 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.484553    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 11:53:20.484832 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.484726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2npzq\""
Sep 15 11:53:20.484952 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.484937    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e9bc87-serving-cert\""
Sep 15 11:53:20.485023 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.484991    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 11:53:20.506575 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.506548    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"]
Sep 15 11:53:20.551638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.551602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:20.582036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.582004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-metrics-certs\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.582211 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.582050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqf5x\" (UniqueName: \"kubernetes.io/projected/c98cf93c-837c-4be7-8e21-b4a8e9097053-kube-api-access-bqf5x\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.582316 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.582205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c98cf93c-837c-4be7-8e21-b4a8e9097053-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.582316 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.582297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.673828 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.673742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:20.683449 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.683422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqf5x\" (UniqueName: \"kubernetes.io/projected/c98cf93c-837c-4be7-8e21-b4a8e9097053-kube-api-access-bqf5x\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.683621 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.683512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c98cf93c-837c-4be7-8e21-b4a8e9097053-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.683621 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.683539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.683621 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.683588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-metrics-certs\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.683786 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:53:20.683746    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-serving-cert: secret "maas-api-e2e-inf-b-e9bc87-serving-cert" not found
Sep 15 11:53:20.683835 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:53:20.683825    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls podName:c98cf93c-837c-4be7-8e21-b4a8e9097053 nodeName:}" failed. No retries permitted until 2026-09-15 11:53:21.183801324 +0000 UTC m=+898.907543013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls") pod "maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww" (UID: "c98cf93c-837c-4be7-8e21-b4a8e9097053") : secret "maas-api-e2e-inf-b-e9bc87-serving-cert" not found
Sep 15 11:53:20.684300 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.684280    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c98cf93c-837c-4be7-8e21-b4a8e9097053-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.686091 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.686066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-metrics-certs\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.719778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.719744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqf5x\" (UniqueName: \"kubernetes.io/projected/c98cf93c-837c-4be7-8e21-b4a8e9097053-kube-api-access-bqf5x\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:20.884242 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:20.884191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:21.014850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:21.014812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:21.189167 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:21.189126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:21.191545 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:21.191523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:21.393287 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:21.393181    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:21.538489 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:21.538453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:21.683625 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:21.683536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:21.700505 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:21.700478    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"]
Sep 15 11:53:21.703907 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:53:21.703884    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98cf93c_837c_4be7_8e21_b4a8e9097053.slice/crio-a2b059e1dfb6b4bfb56dac6afe68e6f01e937c2ef9a0cd9b6483816c94990f76 WatchSource:0}: Error finding container a2b059e1dfb6b4bfb56dac6afe68e6f01e937c2ef9a0cd9b6483816c94990f76: Status 404 returned error can't find the container with id a2b059e1dfb6b4bfb56dac6afe68e6f01e937c2ef9a0cd9b6483816c94990f76
Sep 15 11:53:22.079595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:22.079535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww" event={"ID":"c98cf93c-837c-4be7-8e21-b4a8e9097053","Type":"ContainerStarted","Data":"a2b059e1dfb6b4bfb56dac6afe68e6f01e937c2ef9a0cd9b6483816c94990f76"}
Sep 15 11:53:22.260947 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:22.260909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:23.397658 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:23.397622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:24.292436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:24.292399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:24.464264 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:24.463719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:24.573051 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:24.572907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:25.097928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:25.097890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww" event={"ID":"c98cf93c-837c-4be7-8e21-b4a8e9097053","Type":"ContainerStarted","Data":"538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985"}
Sep 15 11:53:25.098112 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:25.097997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:25.118271 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:25.118157    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww" podStartSLOduration=2.097141438 podStartE2EDuration="5.1181413s" totalImagesPullingTime="3.020999862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:25.117065891 +0000 UTC m=+902.840807599" watchObservedRunningTime="2026-09-15 11:53:25.1181413 +0000 UTC m=+902.841883000"
Sep 15 11:53:25.491249 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:25.491198    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:26.367828 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:26.367790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:27.181819 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:27.181788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:28.026065 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:28.026029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:28.855577 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:28.855545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:29.823511 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:29.823474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:30.088549 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:30.088475    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:53:30.641789 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:30.641760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:31.108342 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:31.108312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 11:53:31.146320 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:31.146281    2564 generic.go:356] "Generic (PLEG): container finished" podID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerID="e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337" exitCode=0
Sep 15 11:53:31.146498 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:31.146353    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" event={"ID":"d716e70e-417d-47e9-b112-9ba03d31ed61","Type":"ContainerDied","Data":"e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337"}
Sep 15 11:53:31.146792 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:31.146774    2564 scope.go:117] "RemoveContainer" containerID="e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337"
Sep 15 11:53:31.147994 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:31.147964    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:31.148192 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:31.148032    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:31.148192 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:31.148093    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:31.619890 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:31.619858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:32.157178 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:32.157133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" event={"ID":"d716e70e-417d-47e9-b112-9ba03d31ed61","Type":"ContainerStarted","Data":"56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56"}
Sep 15 11:53:32.336397 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:32.336357    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:32.337568 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:32.337540    2564 patch_prober.go:28] interesting pod/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 11:53:32.337684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:32.337601    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 11:53:33.337069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:33.337029    2564 patch_prober.go:28] interesting pod/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 11:53:33.337477 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:33.337087    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 11:53:33.939393 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:33.939356    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:34.337198 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:34.337115    2564 patch_prober.go:28] interesting pod/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 11:53:34.337694 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:34.337312    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 11:53:35.336310 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.336275    2564 patch_prober.go:28] interesting pod/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 11:53:35.336485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.336331    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 11:53:35.478860 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.478767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.592300 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.590769    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.735732 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.735688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.836517 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.836490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.978285 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.976704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.983240 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.978661    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"]
Sep 15 11:53:35.983240 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:35.978868    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy" containerID="cri-o://56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56" gracePeriod=30
Sep 15 11:53:36.133887 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:36.133851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:36.439461 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:36.439419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:36.538869 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:36.538826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:36.640075 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:36.640039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:37.003740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:37.003689    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:37.100953 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:37.100915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:37.205763 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:37.205660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:38.029542 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:38.029507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:38.907300 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:38.907270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:39.579928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:39.579897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:39.680966 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:39.680927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:39.781255 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:39.781209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:40.955603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:40.955571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:41.223731 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:41.223651    2564 generic.go:356] "Generic (PLEG): container finished" podID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerID="8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d" exitCode=0
Sep 15 11:53:41.223889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:41.223723    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" event={"ID":"b4a09514-b3a1-4dc8-b788-fab03de797c3","Type":"ContainerDied","Data":"8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d"}
Sep 15 11:53:41.224191 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:41.224177    2564 scope.go:117] "RemoveContainer" containerID="8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d"
Sep 15 11:53:41.225315 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:41.225288    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:41.225374 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:41.225354    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:41.225409 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:41.225386    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:53:41.389881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:41.389847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:41.977789 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:41.977755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:42.232252 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.232153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" event={"ID":"b4a09514-b3a1-4dc8-b788-fab03de797c3","Type":"ContainerStarted","Data":"345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401"}
Sep 15 11:53:42.363422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.363361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:42.553726 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.553633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:42.816150 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.816044    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:42.817148 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.817125    2564 patch_prober.go:28] interesting pod/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 11:53:42.817210 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.817191    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 11:53:42.841897 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.841873    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:42.865465 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865434    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d716e70e-417d-47e9-b112-9ba03d31ed61-istiod-ca-cert\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.865709 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865684    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-credential-socket\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.865815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865782    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d24sm\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-kube-api-access-d24sm\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.865815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865807    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-data\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.865948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865837    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d716e70e-417d-47e9-b112-9ba03d31ed61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:42.865948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-socket\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.865948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865943    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-certs\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.866098 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865967    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-podinfo\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.866098 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865997    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-envoy\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.866098 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866042    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-token\") pod \"d716e70e-417d-47e9-b112-9ba03d31ed61\" (UID: \"d716e70e-417d-47e9-b112-9ba03d31ed61\") "
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.865940    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866139    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-data" (OuterVolumeSpecName: "istio-data") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866254    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866489    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d716e70e-417d-47e9-b112-9ba03d31ed61-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866507    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866521    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866533    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:42.866582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.866545    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:42.868953 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.868904    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-kube-api-access-d24sm" (OuterVolumeSpecName: "kube-api-access-d24sm") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "kube-api-access-d24sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:42.868953 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.868935    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-token" (OuterVolumeSpecName: "istio-token") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:42.869129 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.869104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:42.869934 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.869913    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d716e70e-417d-47e9-b112-9ba03d31ed61" (UID: "d716e70e-417d-47e9-b112-9ba03d31ed61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:53:42.968009 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.967979    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:42.968009 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.968003    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:42.968009 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.968011    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:42.968271 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:42.968019    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d24sm\" (UniqueName: \"kubernetes.io/projected/d716e70e-417d-47e9-b112-9ba03d31ed61-kube-api-access-d24sm\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:53:43.180280 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.180189    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"]
Sep 15 11:53:43.180765 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.180748    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy"
Sep 15 11:53:43.180816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.180767    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy"
Sep 15 11:53:43.180861 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.180852    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy"
Sep 15 11:53:43.180903 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.180867    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy"
Sep 15 11:53:43.183473 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.183455    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.185805 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.185778    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-6347dad8-serving-cert\""
Sep 15 11:53:43.194979 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.194957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"]
Sep 15 11:53:43.216811 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.216774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:43.240280 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.240251    2564 generic.go:356] "Generic (PLEG): container finished" podID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerID="56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56" exitCode=0
Sep 15 11:53:43.240461 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.240283    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" event={"ID":"d716e70e-417d-47e9-b112-9ba03d31ed61","Type":"ContainerDied","Data":"56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56"}
Sep 15 11:53:43.240461 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.240348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74" event={"ID":"d716e70e-417d-47e9-b112-9ba03d31ed61","Type":"ContainerDied","Data":"787071c63bd8a291fe8255e2ba831eb5447cd9c424dd89a5143d86a557bb35bb"}
Sep 15 11:53:43.240461 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.240296    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"
Sep 15 11:53:43.240461 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.240379    2564 scope.go:117] "RemoveContainer" containerID="56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56"
Sep 15 11:53:43.249982 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.249966    2564 scope.go:117] "RemoveContainer" containerID="e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337"
Sep 15 11:53:43.257837 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.257821    2564 scope.go:117] "RemoveContainer" containerID="56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56"
Sep 15 11:53:43.258106 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:53:43.258087    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56\": container with ID starting with 56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56 not found: ID does not exist" containerID="56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56"
Sep 15 11:53:43.258165 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.258115    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56"} err="failed to get container status \"56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56\": rpc error: code = NotFound desc = could not find container \"56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56\": container with ID starting with 56803f899764a8849646053ac89033cd5ec141cc8827f2c95f69e5b089630b56 not found: ID does not exist"
Sep 15 11:53:43.258165 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.258131    2564 scope.go:117] "RemoveContainer" containerID="e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337"
Sep 15 11:53:43.258422 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:53:43.258407    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337\": container with ID starting with e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337 not found: ID does not exist" containerID="e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337"
Sep 15 11:53:43.258478 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.258425    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337"} err="failed to get container status \"e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337\": rpc error: code = NotFound desc = could not find container \"e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337\": container with ID starting with e1eb5a395632b389078d6edcdb6b537b1f31dcc81f5e8df3e4b53b7648c46337 not found: ID does not exist"
Sep 15 11:53:43.263714 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.263694    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"]
Sep 15 11:53:43.269672 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.269647    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs76b\" (UniqueName: \"kubernetes.io/projected/345aa4ab-a943-450d-a4bc-ee1d029493bc-kube-api-access-rs76b\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.269781 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.269706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.269831 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.269809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-metrics-certs\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.269893 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.269877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/345aa4ab-a943-450d-a4bc-ee1d029493bc-openshift-service-ca\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.271721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.271702    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74"]
Sep 15 11:53:43.296909 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.296826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:43.371414 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.371372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs76b\" (UniqueName: \"kubernetes.io/projected/345aa4ab-a943-450d-a4bc-ee1d029493bc-kube-api-access-rs76b\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.371626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.371441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.371626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.371496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-metrics-certs\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.371626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.371558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/345aa4ab-a943-450d-a4bc-ee1d029493bc-openshift-service-ca\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.372465 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.372431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/345aa4ab-a943-450d-a4bc-ee1d029493bc-openshift-service-ca\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.372589 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:53:43.372537    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-serving-cert: secret "maas-api-e2e-migrate-6347dad8-serving-cert" not found
Sep 15 11:53:43.372668 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:53:43.372615    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls podName:345aa4ab-a943-450d-a4bc-ee1d029493bc nodeName:}" failed. No retries permitted until 2026-09-15 11:53:43.872593129 +0000 UTC m=+921.596334800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls") pod "maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw" (UID: "345aa4ab-a943-450d-a4bc-ee1d029493bc") : secret "maas-api-e2e-migrate-6347dad8-serving-cert" not found
Sep 15 11:53:43.375296 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.375273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-metrics-certs\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.381506 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.381480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs76b\" (UniqueName: \"kubernetes.io/projected/345aa4ab-a943-450d-a4bc-ee1d029493bc-kube-api-access-rs76b\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.463371 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.463314    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:53:43.600112 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.600054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:43.816468 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.816381    2564 patch_prober.go:28] interesting pod/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 11:53:43.816468 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.816442    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 11:53:43.843892 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.843844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:43.877241 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.876373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.879083 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.879063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls\") pod \"maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:43.955360 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:43.955323    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:44.094544 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:44.094468    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:44.409092 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:44.409008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"]
Sep 15 11:53:44.412369 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:53:44.412277    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345aa4ab_a943_450d_a4bc_ee1d029493bc.slice/crio-2e1e79f1c2eaf97e8ea84a1e7290629e077381f9408e3289540a497f5bf45847 WatchSource:0}: Error finding container 2e1e79f1c2eaf97e8ea84a1e7290629e077381f9408e3289540a497f5bf45847: Status 404 returned error can't find the container with id 2e1e79f1c2eaf97e8ea84a1e7290629e077381f9408e3289540a497f5bf45847
Sep 15 11:53:44.761128 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:44.761085    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" path="/var/lib/kubelet/pods/d716e70e-417d-47e9-b112-9ba03d31ed61/volumes"
Sep 15 11:53:44.795739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:44.795704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:44.816935 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:44.816901    2564 patch_prober.go:28] interesting pod/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 11:53:44.817096 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:44.816959    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 11:53:45.273588 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:45.273551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:45.276194 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:45.276158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw" event={"ID":"345aa4ab-a943-450d-a4bc-ee1d029493bc","Type":"ContainerStarted","Data":"0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973"}
Sep 15 11:53:45.276362 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:45.276236    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw" event={"ID":"345aa4ab-a943-450d-a4bc-ee1d029493bc","Type":"ContainerStarted","Data":"2e1e79f1c2eaf97e8ea84a1e7290629e077381f9408e3289540a497f5bf45847"}
Sep 15 11:53:45.276362 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:45.276262    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:53:45.294901 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:45.294852    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw" podStartSLOduration=1.858909695 podStartE2EDuration="2.294835835s" totalImagesPullingTime="435.92614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:45.293959498 +0000 UTC m=+923.017701176" watchObservedRunningTime="2026-09-15 11:53:45.294835835 +0000 UTC m=+923.018577522"
Sep 15 11:53:45.774279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:45.774240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:45.816244 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:45.816185    2564 patch_prober.go:28] interesting pod/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 11:53:45.816400 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:45.816269    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 11:53:46.026366 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:46.026282    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:46.061915 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:46.061875    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:46.752183 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:46.752148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:46.816553 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:46.816515    2564 patch_prober.go:28] interesting pod/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 11:53:46.816957 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:46.816573    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 11:53:46.852958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:46.852920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:47.816640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:47.816604    2564 patch_prober.go:28] interesting pod/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 11:53:47.817019 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:47.816658    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 11:53:48.817184 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:48.817148    2564 patch_prober.go:28] interesting pod/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 11:53:48.817601 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:48.817204    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 11:53:49.820334 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:49.820306    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:49.821411 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:49.821389    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 11:53:51.290242 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:53:51.290190    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:54:01.364003 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:01.363970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:01.858263 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:01.858231    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:54:05.508039 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:05.507999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:06.382659 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:06.382627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:07.388250 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:07.388178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:08.257425 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:08.257393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:09.118438 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:09.118406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:10.220045 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:10.220013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:11.094337 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:11.094299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:12.018616 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:12.018579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:12.243419 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:12.243381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:12.346739 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:12.346660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:12.806158 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:12.806128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:13.614689 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:13.614649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:14.419073 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:14.419039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:15.265898 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:15.265860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:19.291927 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:19.291896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:20.271919 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:20.271891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:20.888187 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:20.888157    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"]
Sep 15 11:54:20.888661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:20.888382    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw" podUID="345aa4ab-a943-450d-a4bc-ee1d029493bc" containerName="maas-api" containerID="cri-o://0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973" gracePeriod=30
Sep 15 11:54:20.917576 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:20.917547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:21.013021 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.012968    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:21.073321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.073293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:21.133060 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.133039    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:54:21.154525 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.154448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:21.164504 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.164479    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-metrics-certs\") pod \"345aa4ab-a943-450d-a4bc-ee1d029493bc\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") "
Sep 15 11:54:21.164626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.164528    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/345aa4ab-a943-450d-a4bc-ee1d029493bc-openshift-service-ca\") pod \"345aa4ab-a943-450d-a4bc-ee1d029493bc\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") "
Sep 15 11:54:21.164626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.164562    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs76b\" (UniqueName: \"kubernetes.io/projected/345aa4ab-a943-450d-a4bc-ee1d029493bc-kube-api-access-rs76b\") pod \"345aa4ab-a943-450d-a4bc-ee1d029493bc\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") "
Sep 15 11:54:21.164626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.164604    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls\") pod \"345aa4ab-a943-450d-a4bc-ee1d029493bc\" (UID: \"345aa4ab-a943-450d-a4bc-ee1d029493bc\") "
Sep 15 11:54:21.165013 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.164978    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345aa4ab-a943-450d-a4bc-ee1d029493bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "345aa4ab-a943-450d-a4bc-ee1d029493bc" (UID: "345aa4ab-a943-450d-a4bc-ee1d029493bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:54:21.166613 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.166587    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "345aa4ab-a943-450d-a4bc-ee1d029493bc" (UID: "345aa4ab-a943-450d-a4bc-ee1d029493bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:54:21.166755 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.166738    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345aa4ab-a943-450d-a4bc-ee1d029493bc-kube-api-access-rs76b" (OuterVolumeSpecName: "kube-api-access-rs76b") pod "345aa4ab-a943-450d-a4bc-ee1d029493bc" (UID: "345aa4ab-a943-450d-a4bc-ee1d029493bc"). InnerVolumeSpecName "kube-api-access-rs76b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:54:21.166844 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.166824    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "345aa4ab-a943-450d-a4bc-ee1d029493bc" (UID: "345aa4ab-a943-450d-a4bc-ee1d029493bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:54:21.221615 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.221580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:21.267921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.267828    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:54:21.267921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.267864    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/345aa4ab-a943-450d-a4bc-ee1d029493bc-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:54:21.267921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.267882    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs76b\" (UniqueName: \"kubernetes.io/projected/345aa4ab-a943-450d-a4bc-ee1d029493bc-kube-api-access-rs76b\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:54:21.267921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.267895    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/345aa4ab-a943-450d-a4bc-ee1d029493bc-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:54:21.320975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.320927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:21.474912 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.474881    2564 generic.go:356] "Generic (PLEG): container finished" podID="345aa4ab-a943-450d-a4bc-ee1d029493bc" containerID="0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973" exitCode=0
Sep 15 11:54:21.475108 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.474924    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"
Sep 15 11:54:21.475108 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.474962    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw" event={"ID":"345aa4ab-a943-450d-a4bc-ee1d029493bc","Type":"ContainerDied","Data":"0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973"}
Sep 15 11:54:21.475108 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.475019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw" event={"ID":"345aa4ab-a943-450d-a4bc-ee1d029493bc","Type":"ContainerDied","Data":"2e1e79f1c2eaf97e8ea84a1e7290629e077381f9408e3289540a497f5bf45847"}
Sep 15 11:54:21.475108 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.475051    2564 scope.go:117] "RemoveContainer" containerID="0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973"
Sep 15 11:54:21.484810 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.484793    2564 scope.go:117] "RemoveContainer" containerID="0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973"
Sep 15 11:54:21.485050 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:54:21.485031    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973\": container with ID starting with 0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973 not found: ID does not exist" containerID="0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973"
Sep 15 11:54:21.485101 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.485058    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973"} err="failed to get container status \"0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973\": rpc error: code = NotFound desc = could not find container \"0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973\": container with ID starting with 0fe1eec13a6d089001b1b5e2c31bbf49b01130c0f9c5e10a486bf6f1af07a973 not found: ID does not exist"
Sep 15 11:54:21.497334 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.497310    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"]
Sep 15 11:54:21.501537 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.501515    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6347dad8-7cdc6f5c-zgbdw"]
Sep 15 11:54:21.580644 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.580606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:21.746409 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:21.746320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:22.048635 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.048544    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"]
Sep 15 11:54:22.049009 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.048995    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy"
Sep 15 11:54:22.049053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.049011    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d716e70e-417d-47e9-b112-9ba03d31ed61" containerName="istio-proxy"
Sep 15 11:54:22.049053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.049027    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="345aa4ab-a943-450d-a4bc-ee1d029493bc" containerName="maas-api"
Sep 15 11:54:22.049053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.049033    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="345aa4ab-a943-450d-a4bc-ee1d029493bc" containerName="maas-api"
Sep 15 11:54:22.049151 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.049102    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="345aa4ab-a943-450d-a4bc-ee1d029493bc" containerName="maas-api"
Sep 15 11:54:22.052280 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.052263    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.054506 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.054488    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-917f4c86-openshift-default-dockercfg-hkr42\""
Sep 15 11:54:22.063483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.063460    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"]
Sep 15 11:54:22.076833 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.076811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:22.176700 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.176671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-certs\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.176889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.176747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-envoy\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.176889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.176784    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-data\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.176889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.176803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-socket\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.176889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.176820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzmfj\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-kube-api-access-rzmfj\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.177119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.176901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-credential-socket\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.177119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.176953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-token\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.177119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.176996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istiod-ca-cert\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.177119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.177069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-podinfo\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.222522 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.222492    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:22.278836 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.278792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-envoy\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279024 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.278911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-data\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279024 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.278947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-socket\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279024 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.278981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzmfj\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-kube-api-access-rzmfj\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279203 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.279029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-credential-socket\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279203 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.279059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-token\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279203 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.279083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istiod-ca-cert\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279203 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.279143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-podinfo\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.279253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-certs\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.279780 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.279755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-certs\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.281190 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.280899    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istiod-ca-cert\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.281339 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.281325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-data\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.285237 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.281671    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-credential-socket\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.285237 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.281846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-socket\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.285237 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.282098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-envoy\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.285237 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.283923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-podinfo\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.288887 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.288866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzmfj\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-kube-api-access-rzmfj\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.289378 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.289360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-token\") pod \"e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") " pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.351821 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.351746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:22.362877 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.362850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:22.639815 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.639727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"]
Sep 15 11:54:22.647349 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:54:22.647323    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9321c2e3_f5f2_4bfe_b45a_3ccb26ec25a1.slice/crio-3a6d62968b36d5ab708700afdf5a27e07fee9c1823e3d3bf705fd66366d62da0 WatchSource:0}: Error finding container 3a6d62968b36d5ab708700afdf5a27e07fee9c1823e3d3bf705fd66366d62da0: Status 404 returned error can't find the container with id 3a6d62968b36d5ab708700afdf5a27e07fee9c1823e3d3bf705fd66366d62da0
Sep 15 11:54:22.649958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.649926    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:22.650027 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.649994    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:22.650068 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.650021    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:22.759424 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:22.759393    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="345aa4ab-a943-450d-a4bc-ee1d029493bc" path="/var/lib/kubelet/pods/345aa4ab-a943-450d-a4bc-ee1d029493bc/volumes"
Sep 15 11:54:23.194813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:23.194782    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:23.487582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:23.487487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" event={"ID":"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1","Type":"ContainerStarted","Data":"6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2"}
Sep 15 11:54:23.487582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:23.487550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" event={"ID":"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1","Type":"ContainerStarted","Data":"3a6d62968b36d5ab708700afdf5a27e07fee9c1823e3d3bf705fd66366d62da0"}
Sep 15 11:54:23.510964 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:23.510911    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" podStartSLOduration=1.510893185 podStartE2EDuration="1.510893185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:23.508327958 +0000 UTC m=+961.232069644" watchObservedRunningTime="2026-09-15 11:54:23.510893185 +0000 UTC m=+961.234634871"
Sep 15 11:54:24.279520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:24.279483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:24.363307 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:24.363275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:24.368509 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:24.368485    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:24.492747 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:24.492723    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:24.493704 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:24.493686    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:24.898595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:24.898557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:24.987179 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:24.987140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:25.113162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:25.113128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:26.007136 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.007102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:26.701767 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.701733    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"]
Sep 15 11:54:26.705138 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.705121    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.707823 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.707803    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-917f4c86-serving-cert\""
Sep 15 11:54:26.718101 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.718074    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"]
Sep 15 11:54:26.779831 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.779805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:26.822609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.822578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-metrics-certs\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.822742 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.822694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv96v\" (UniqueName: \"kubernetes.io/projected/ff5577a7-f1c7-4c68-b61b-0404869387fe-kube-api-access-zv96v\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.822742 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.822729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-maas-api-tls\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.822839 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.822780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5577a7-f1c7-4c68-b61b-0404869387fe-openshift-service-ca\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.893092 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.893057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:26.924390 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.924363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-metrics-certs\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.924578 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.924458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv96v\" (UniqueName: \"kubernetes.io/projected/ff5577a7-f1c7-4c68-b61b-0404869387fe-kube-api-access-zv96v\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.924578 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.924493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-maas-api-tls\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.924578 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.924530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5577a7-f1c7-4c68-b61b-0404869387fe-openshift-service-ca\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.925078 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.925056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5577a7-f1c7-4c68-b61b-0404869387fe-openshift-service-ca\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.926882 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.926859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-metrics-certs\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.926980 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.926869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-maas-api-tls\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.938024 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.937998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv96v\" (UniqueName: \"kubernetes.io/projected/ff5577a7-f1c7-4c68-b61b-0404869387fe-kube-api-access-zv96v\") pod \"maas-api-e2e-ait-917f4c86-578f976749-59tms\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:26.983733 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:26.983665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:27.017885 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:27.017857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:27.299123 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:27.299097    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"]
Sep 15 11:54:27.300916 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:54:27.300893    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5577a7_f1c7_4c68_b61b_0404869387fe.slice/crio-03ae5ee39f5fcd91b7c4ff591f96c514dc697675887ebc39070a02d381c569ff WatchSource:0}: Error finding container 03ae5ee39f5fcd91b7c4ff591f96c514dc697675887ebc39070a02d381c569ff: Status 404 returned error can't find the container with id 03ae5ee39f5fcd91b7c4ff591f96c514dc697675887ebc39070a02d381c569ff
Sep 15 11:54:27.336778 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:27.336748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:27.365726 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:27.365691    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:54:27.509995 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:27.509960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms" event={"ID":"ff5577a7-f1c7-4c68-b61b-0404869387fe","Type":"ContainerStarted","Data":"03ae5ee39f5fcd91b7c4ff591f96c514dc697675887ebc39070a02d381c569ff"}
Sep 15 11:54:28.516845 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:28.516809    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms" event={"ID":"ff5577a7-f1c7-4c68-b61b-0404869387fe","Type":"ContainerStarted","Data":"2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045"}
Sep 15 11:54:28.517267 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:28.516874    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:28.544377 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:28.544322    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms" podStartSLOduration=2.200548841 podStartE2EDuration="2.544305882s" totalImagesPullingTime="343.757041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:28.542100573 +0000 UTC m=+966.265842252" watchObservedRunningTime="2026-09-15 11:54:28.544305882 +0000 UTC m=+966.268047598"
Sep 15 11:54:28.873504 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:28.873416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:29.505977 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:29.505940    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:30.416757 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:30.416728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:34.528408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:34.528378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:34.651983 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:34.651942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:34.717182 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:34.717132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:43.662496 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:43.662464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:54:46.614936 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:46.614902    2564 generic.go:356] "Generic (PLEG): container finished" podID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerID="6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2" exitCode=0
Sep 15 11:54:46.615317 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:46.614970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" event={"ID":"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1","Type":"ContainerDied","Data":"6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2"}
Sep 15 11:54:46.615418 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:46.615404    2564 scope.go:117] "RemoveContainer" containerID="6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2"
Sep 15 11:54:46.616533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:46.616504    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:46.616638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:46.616584    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:46.616638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:46.616632    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:47.622574 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:47.622538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" event={"ID":"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1","Type":"ContainerStarted","Data":"bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711"}
Sep 15 11:54:48.363478 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:48.363442    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:48.363685 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:48.363493    2564 patch_prober.go:28] interesting pod/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:54:48.363685 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:48.363555    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 15 11:54:48.856240 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:48.856190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:49.371321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:49.371287    2564 patch_prober.go:28] interesting pod/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:54:49.371611 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:49.371580    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 15 11:54:49.386380 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:49.386351    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:49.715972 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:49.715935    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:50.363882 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:50.363846    2564 patch_prober.go:28] interesting pod/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:54:50.364861 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:50.364474    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 15 11:54:50.502623 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:50.502593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:51.326737 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:51.326704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:51.363968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:51.363930    2564 patch_prober.go:28] interesting pod/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:54:51.364454 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:51.364003    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 15 11:54:52.130906 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:52.130874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:52.364118 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:52.364071    2564 patch_prober.go:28] interesting pod/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 15 11:54:52.364748 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:52.364714    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 15 11:54:52.999236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:52.999191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:53.368047 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:53.367974    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:53.368421 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:53.368252    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:53.368821 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:53.368804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:54:53.703466 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:53.703430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:54.396134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:54.396104    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:55.206497 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:55.206456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:55.911858 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:55.911825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:56.627642 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.627614    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"]
Sep 15 11:54:56.627889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.627863    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms" podUID="ff5577a7-f1c7-4c68-b61b-0404869387fe" containerName="maas-api" containerID="cri-o://2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045" gracePeriod=30
Sep 15 11:54:56.655364 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.655336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:56.722927 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.722899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:56.824594 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.824561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:56.863145 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.862936    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:54:56.878541 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.878490    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:56.909616 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.909542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:56.954965 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.954935    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5577a7-f1c7-4c68-b61b-0404869387fe-openshift-service-ca\") pod \"ff5577a7-f1c7-4c68-b61b-0404869387fe\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") "
Sep 15 11:54:56.955383 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.954987    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-metrics-certs\") pod \"ff5577a7-f1c7-4c68-b61b-0404869387fe\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") "
Sep 15 11:54:56.955383 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.955019    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-maas-api-tls\") pod \"ff5577a7-f1c7-4c68-b61b-0404869387fe\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") "
Sep 15 11:54:56.955383 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.955109    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv96v\" (UniqueName: \"kubernetes.io/projected/ff5577a7-f1c7-4c68-b61b-0404869387fe-kube-api-access-zv96v\") pod \"ff5577a7-f1c7-4c68-b61b-0404869387fe\" (UID: \"ff5577a7-f1c7-4c68-b61b-0404869387fe\") "
Sep 15 11:54:56.955383 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.955356    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5577a7-f1c7-4c68-b61b-0404869387fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff5577a7-f1c7-4c68-b61b-0404869387fe" (UID: "ff5577a7-f1c7-4c68-b61b-0404869387fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:54:56.955610 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.955432    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5577a7-f1c7-4c68-b61b-0404869387fe-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:54:56.957318 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.957288    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ff5577a7-f1c7-4c68-b61b-0404869387fe" (UID: "ff5577a7-f1c7-4c68-b61b-0404869387fe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:54:56.957664 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.957643    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff5577a7-f1c7-4c68-b61b-0404869387fe" (UID: "ff5577a7-f1c7-4c68-b61b-0404869387fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:54:56.957763 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:56.957706    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5577a7-f1c7-4c68-b61b-0404869387fe-kube-api-access-zv96v" (OuterVolumeSpecName: "kube-api-access-zv96v") pod "ff5577a7-f1c7-4c68-b61b-0404869387fe" (UID: "ff5577a7-f1c7-4c68-b61b-0404869387fe"). InnerVolumeSpecName "kube-api-access-zv96v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:54:57.056932 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.056893    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:54:57.056932 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.056930    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff5577a7-f1c7-4c68-b61b-0404869387fe-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:54:57.057124 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.056945    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv96v\" (UniqueName: \"kubernetes.io/projected/ff5577a7-f1c7-4c68-b61b-0404869387fe-kube-api-access-zv96v\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:54:57.411179 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.411140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:57.674018 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.673937    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff5577a7-f1c7-4c68-b61b-0404869387fe" containerID="2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045" exitCode=0
Sep 15 11:54:57.674018 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.673995    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"
Sep 15 11:54:57.674212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.674022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms" event={"ID":"ff5577a7-f1c7-4c68-b61b-0404869387fe","Type":"ContainerDied","Data":"2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045"}
Sep 15 11:54:57.674212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.674095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms" event={"ID":"ff5577a7-f1c7-4c68-b61b-0404869387fe","Type":"ContainerDied","Data":"03ae5ee39f5fcd91b7c4ff591f96c514dc697675887ebc39070a02d381c569ff"}
Sep 15 11:54:57.674212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.674120    2564 scope.go:117] "RemoveContainer" containerID="2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045"
Sep 15 11:54:57.683869 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.683851    2564 scope.go:117] "RemoveContainer" containerID="2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045"
Sep 15 11:54:57.684117 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:54:57.684099    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045\": container with ID starting with 2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045 not found: ID does not exist" containerID="2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045"
Sep 15 11:54:57.684210 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.684126    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045"} err="failed to get container status \"2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045\": rpc error: code = NotFound desc = could not find container \"2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045\": container with ID starting with 2ac8a0c73151918d62bc488c7bdd3150b4886bc2bd4d632cb075be8b942cf045 not found: ID does not exist"
Sep 15 11:54:57.707185 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.707155    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"]
Sep 15 11:54:57.712646 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:57.712619    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-917f4c86-578f976749-59tms"]
Sep 15 11:54:58.045213 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.045179    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"]
Sep 15 11:54:58.045702 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.045428    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy" containerID="cri-o://bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711" gracePeriod=30
Sep 15 11:54:58.070456 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.070421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:58.369617 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.369525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:58.490037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.490008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:58.758934 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.758895    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5577a7-f1c7-4c68-b61b-0404869387fe" path="/var/lib/kubelet/pods/ff5577a7-f1c7-4c68-b61b-0404869387fe/volumes"
Sep 15 11:54:58.759185 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.759170    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"]
Sep 15 11:54:58.759631 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.759618    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5577a7-f1c7-4c68-b61b-0404869387fe" containerName="maas-api"
Sep 15 11:54:58.759679 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.759633    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5577a7-f1c7-4c68-b61b-0404869387fe" containerName="maas-api"
Sep 15 11:54:58.759715 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.759698    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5577a7-f1c7-4c68-b61b-0404869387fe" containerName="maas-api"
Sep 15 11:54:58.762879 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.762861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.765351 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.765332    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b407aeb7-openshift-default-dockercfg-h57b6\""
Sep 15 11:54:58.770476 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.770185    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"]
Sep 15 11:54:58.787762 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.787722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:58.874837 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.874801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-envoy\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.875007 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.874841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-certs\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.875007 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.874867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-socket\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.875007 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.874895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-istio-token\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.875007 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.874944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-data\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.875007 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.874981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-credential-socket\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.875325 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.875062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8428fb02-3dee-44b7-8817-381caa2bb518-istio-podinfo\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.875325 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.875114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwkkc\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-kube-api-access-dwkkc\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.875325 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.875179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8428fb02-3dee-44b7-8817-381caa2bb518-istiod-ca-cert\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.883053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.883030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:58.976275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8428fb02-3dee-44b7-8817-381caa2bb518-istiod-ca-cert\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-envoy\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-certs\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-socket\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-istio-token\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-data\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-credential-socket\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8428fb02-3dee-44b7-8817-381caa2bb518-istio-podinfo\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkkc\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-kube-api-access-dwkkc\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-certs\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976971 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-data\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.976971 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.976908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-socket\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.977078 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.977034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-credential-socket\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.977078 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.977068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8428fb02-3dee-44b7-8817-381caa2bb518-istiod-ca-cert\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.978654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.978637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-envoy\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.979090 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.979068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8428fb02-3dee-44b7-8817-381caa2bb518-istio-podinfo\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.987591 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.987566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-istio-token\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:58.987788 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:58.987760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwkkc\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-kube-api-access-dwkkc\") pod \"e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") " pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:59.074499 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.074399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:54:59.357049 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.357020    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"]
Sep 15 11:54:59.359002 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:54:59.358976    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8428fb02_3dee_44b7_8817_381caa2bb518.slice/crio-206d7e73dd06fc8cbb0b5e2fb5abb2dea402d0f000f5b0088dd090e11120e46f WatchSource:0}: Error finding container 206d7e73dd06fc8cbb0b5e2fb5abb2dea402d0f000f5b0088dd090e11120e46f: Status 404 returned error can't find the container with id 206d7e73dd06fc8cbb0b5e2fb5abb2dea402d0f000f5b0088dd090e11120e46f
Sep 15 11:54:59.361372 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.361339    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:59.361485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.361416    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:59.361485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.361462    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:54:59.388359 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.388331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:59.688651 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.688616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" event={"ID":"8428fb02-3dee-44b7-8817-381caa2bb518","Type":"ContainerStarted","Data":"6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690"}
Sep 15 11:54:59.688836 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.688685    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" event={"ID":"8428fb02-3dee-44b7-8817-381caa2bb518","Type":"ContainerStarted","Data":"206d7e73dd06fc8cbb0b5e2fb5abb2dea402d0f000f5b0088dd090e11120e46f"}
Sep 15 11:54:59.709813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:54:59.709757    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" podStartSLOduration=1.709740242 podStartE2EDuration="1.709740242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:59.70809895 +0000 UTC m=+997.431840638" watchObservedRunningTime="2026-09-15 11:54:59.709740242 +0000 UTC m=+997.433481997"
Sep 15 11:55:00.075550 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:00.075466    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:55:00.080601 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:00.080576    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:55:00.141172 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:00.141137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:00.693910 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:00.693886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:55:00.694745 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:00.694721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:55:01.049496 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:01.049409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:01.149626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:01.149594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:01.249492 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:01.249457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:02.204870 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:02.204833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:02.947400 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:02.947367    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"]
Sep 15 11:55:02.950351 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:02.950327    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:02.953269 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:02.953248    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b407aeb7-serving-cert\""
Sep 15 11:55:02.961975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:02.961948    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"]
Sep 15 11:55:02.984247 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:02.984201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:03.020587 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.020549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87422947-e057-41f9-932a-cac136e5b405-openshift-service-ca\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.020740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.020609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.020740 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.020668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-metrics-certs\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.020808 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.020770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5pvq\" (UniqueName: \"kubernetes.io/projected/87422947-e057-41f9-932a-cac136e5b405-kube-api-access-d5pvq\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.085942 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.085913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:03.122146 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.122117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.122310 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.122154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-metrics-certs\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.122310 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.122255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5pvq\" (UniqueName: \"kubernetes.io/projected/87422947-e057-41f9-932a-cac136e5b405-kube-api-access-d5pvq\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.122310 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:55:03.122287    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-serving-cert: secret "maas-api-e2e-derive-b407aeb7-serving-cert" not found
Sep 15 11:55:03.122310 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.122305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87422947-e057-41f9-932a-cac136e5b405-openshift-service-ca\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.122523 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:55:03.122349    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls podName:87422947-e057-41f9-932a-cac136e5b405 nodeName:}" failed. No retries permitted until 2026-09-15 11:55:03.622328866 +0000 UTC m=+1001.346070547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls") pod "maas-api-e2e-derive-b407aeb7-864ff86698-p7s84" (UID: "87422947-e057-41f9-932a-cac136e5b405") : secret "maas-api-e2e-derive-b407aeb7-serving-cert" not found
Sep 15 11:55:03.122931 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.122914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87422947-e057-41f9-932a-cac136e5b405-openshift-service-ca\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.124581 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.124560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-metrics-certs\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.133102 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.133082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5pvq\" (UniqueName: \"kubernetes.io/projected/87422947-e057-41f9-932a-cac136e5b405-kube-api-access-d5pvq\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.296365 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.296341    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:55:03.371538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.371507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:03.424462 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-certs\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.424607 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424480    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-token\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.424607 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424538    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-podinfo\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.424607 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424575    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzmfj\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-kube-api-access-rzmfj\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.424766 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424646    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-envoy\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.424766 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424677    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-data\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.424766 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424705    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-credential-socket\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.424916 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:03.424916 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424772    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istiod-ca-cert\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.424916 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424820    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-socket\") pod \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\" (UID: \"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1\") "
Sep 15 11:55:03.425069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.424986    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:03.425243 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.425199    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:03.425369 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.425257    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:55:03.425450 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.425403    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.425450 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.425424    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.425450 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.425438    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.425600 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.425451    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.425695 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.425674    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:03.427036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.427008    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:55:03.427036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.427013    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-kube-api-access-rzmfj" (OuterVolumeSpecName: "kube-api-access-rzmfj") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "kube-api-access-rzmfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:03.427207 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.427182    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:03.427273 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.427210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" (UID: "9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:03.492400 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.492314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:03.526443 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.526413    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.526443 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.526440    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.526643 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.526453    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzmfj\" (UniqueName: \"kubernetes.io/projected/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-kube-api-access-rzmfj\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.526643 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.526467    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.526643 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.526478    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:03.593452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.593417    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:03.627633 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.627596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.630199 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.630175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls\") pod \"maas-api-e2e-derive-b407aeb7-864ff86698-p7s84\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.715234 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.715178    2564 generic.go:356] "Generic (PLEG): container finished" podID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerID="bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711" exitCode=0
Sep 15 11:55:03.715407 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.715302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" event={"ID":"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1","Type":"ContainerDied","Data":"bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711"}
Sep 15 11:55:03.715407 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.715355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92" event={"ID":"9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1","Type":"ContainerDied","Data":"3a6d62968b36d5ab708700afdf5a27e07fee9c1823e3d3bf705fd66366d62da0"}
Sep 15 11:55:03.715407 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.715383    2564 scope.go:117] "RemoveContainer" containerID="bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711"
Sep 15 11:55:03.715588 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.715543    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"
Sep 15 11:55:03.732862 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.732843    2564 scope.go:117] "RemoveContainer" containerID="6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2"
Sep 15 11:55:03.741017 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.740997    2564 scope.go:117] "RemoveContainer" containerID="bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711"
Sep 15 11:55:03.741338 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:55:03.741317    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711\": container with ID starting with bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711 not found: ID does not exist" containerID="bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711"
Sep 15 11:55:03.741422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.741351    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711"} err="failed to get container status \"bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711\": rpc error: code = NotFound desc = could not find container \"bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711\": container with ID starting with bafe6e4939286364c5cf145162abf71c32815c6f91f4c08ffac781492ba4b711 not found: ID does not exist"
Sep 15 11:55:03.741422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.741376    2564 scope.go:117] "RemoveContainer" containerID="6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2"
Sep 15 11:55:03.741629 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:55:03.741609    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2\": container with ID starting with 6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2 not found: ID does not exist" containerID="6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2"
Sep 15 11:55:03.741672 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.741636    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2"} err="failed to get container status \"6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2\": rpc error: code = NotFound desc = could not find container \"6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2\": container with ID starting with 6a66b6e3fbf64a70df2c0f355e363a129f855fa5c1df52252c2f615697b0dbf2 not found: ID does not exist"
Sep 15 11:55:03.747423 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.747373    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"]
Sep 15 11:55:03.752880 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.752861    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92"]
Sep 15 11:55:03.863798 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.863764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:03.980498 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:03.980465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:04.144566 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:04.144543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"]
Sep 15 11:55:04.146253 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:55:04.146200    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87422947_e057_41f9_932a_cac136e5b405.slice/crio-037fd6121373eba95e279dc863dc771fe495ec3c45f2675078bb50a7eb0e7722 WatchSource:0}: Error finding container 037fd6121373eba95e279dc863dc771fe495ec3c45f2675078bb50a7eb0e7722: Status 404 returned error can't find the container with id 037fd6121373eba95e279dc863dc771fe495ec3c45f2675078bb50a7eb0e7722
Sep 15 11:55:04.722175 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:04.722135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84" event={"ID":"87422947-e057-41f9-932a-cac136e5b405","Type":"ContainerStarted","Data":"037fd6121373eba95e279dc863dc771fe495ec3c45f2675078bb50a7eb0e7722"}
Sep 15 11:55:04.756044 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:04.756012    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" path="/var/lib/kubelet/pods/9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1/volumes"
Sep 15 11:55:04.791718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:04.791681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:05.504873 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:05.504849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:05.730237 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:05.730188    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84" event={"ID":"87422947-e057-41f9-932a-cac136e5b405","Type":"ContainerStarted","Data":"8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45"}
Sep 15 11:55:05.730698 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:05.730310    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:05.753263 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:05.752147    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84" podStartSLOduration=3.063106994 podStartE2EDuration="3.752118684s" totalImagesPullingTime="689.01169ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:55:05.748143272 +0000 UTC m=+1003.471884959" watchObservedRunningTime="2026-09-15 11:55:05.752118684 +0000 UTC m=+1003.475860371"
Sep 15 11:55:06.302700 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:06.302666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:07.037145 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:07.037112    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:08.961501 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:08.961446    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:09.020846 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:09.020768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:11.740971 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:11.740943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:15.163517 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:15.163483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:55:16.292651 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:16.292603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:25.135428 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:25.135392    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:25.847003 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:25.846973    2564 generic.go:356] "Generic (PLEG): container finished" podID="8428fb02-3dee-44b7-8817-381caa2bb518" containerID="6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690" exitCode=0
Sep 15 11:55:25.847174 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:25.847045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" event={"ID":"8428fb02-3dee-44b7-8817-381caa2bb518","Type":"ContainerDied","Data":"6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690"}
Sep 15 11:55:25.847484 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:25.847469    2564 scope.go:117] "RemoveContainer" containerID="6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690"
Sep 15 11:55:25.848659 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:25.848630    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:55:25.848715 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:25.848701    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:55:25.848750 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:25.848734    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:55:26.084645 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:26.084611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:26.772463 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:26.772428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:26.854494 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:26.854460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" event={"ID":"8428fb02-3dee-44b7-8817-381caa2bb518","Type":"ContainerStarted","Data":"9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a"}
Sep 15 11:55:26.909909 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:26.909873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:27.075504 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:27.075401    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:55:27.076743 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:27.076721    2564 patch_prober.go:28] interesting pod/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 11:55:27.076866 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:27.076767    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 11:55:27.691706 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:27.691672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:28.075594 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:28.075503    2564 patch_prober.go:28] interesting pod/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 11:55:28.075594 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:28.075571    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 11:55:28.484558 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:28.484502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:29.075688 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:29.075652    2564 patch_prober.go:28] interesting pod/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 11:55:29.076103 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:29.075718    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 11:55:29.226032 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:29.225996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:30.030208 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:30.030148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:30.076009 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:30.075971    2564 patch_prober.go:28] interesting pod/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 11:55:30.077005 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:30.076611    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 11:55:30.693850 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:30.693809    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:55:30.794443 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:30.794405    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:31.075377 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:31.075289    2564 patch_prober.go:28] interesting pod/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 11:55:31.075377 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:31.075360    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 11:55:31.686787 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:31.686761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:31.877502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:31.877471    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:55:32.075847 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.075769    2564 patch_prober.go:28] interesting pod/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 11:55:32.076053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.076032    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 11:55:32.383511 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.383428    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"]
Sep 15 11:55:32.383948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.383921    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84" podUID="87422947-e057-41f9-932a-cac136e5b405" containerName="maas-api" containerID="cri-o://8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45" gracePeriod=30
Sep 15 11:55:32.424115 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.424066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:32.502879 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.502847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:32.567759 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.567621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:32.640809 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.640740    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:32.671254 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.671028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:32.738411 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.738381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:32.742426 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.742408    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls\") pod \"87422947-e057-41f9-932a-cac136e5b405\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") "
Sep 15 11:55:32.742500 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.742447    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87422947-e057-41f9-932a-cac136e5b405-openshift-service-ca\") pod \"87422947-e057-41f9-932a-cac136e5b405\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") "
Sep 15 11:55:32.742500 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.742479    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-metrics-certs\") pod \"87422947-e057-41f9-932a-cac136e5b405\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") "
Sep 15 11:55:32.742603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.742587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5pvq\" (UniqueName: \"kubernetes.io/projected/87422947-e057-41f9-932a-cac136e5b405-kube-api-access-d5pvq\") pod \"87422947-e057-41f9-932a-cac136e5b405\" (UID: \"87422947-e057-41f9-932a-cac136e5b405\") "
Sep 15 11:55:32.742829 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.742805    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87422947-e057-41f9-932a-cac136e5b405-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "87422947-e057-41f9-932a-cac136e5b405" (UID: "87422947-e057-41f9-932a-cac136e5b405"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:55:32.743017 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.743002    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87422947-e057-41f9-932a-cac136e5b405-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:32.744685 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.744655    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "87422947-e057-41f9-932a-cac136e5b405" (UID: "87422947-e057-41f9-932a-cac136e5b405"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:55:32.744685 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.744674    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "87422947-e057-41f9-932a-cac136e5b405" (UID: "87422947-e057-41f9-932a-cac136e5b405"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:55:32.744824 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.744750    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87422947-e057-41f9-932a-cac136e5b405-kube-api-access-d5pvq" (OuterVolumeSpecName: "kube-api-access-d5pvq") pod "87422947-e057-41f9-932a-cac136e5b405" (UID: "87422947-e057-41f9-932a-cac136e5b405"). InnerVolumeSpecName "kube-api-access-d5pvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:32.820722 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.820684    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"]
Sep 15 11:55:32.821250 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.821199    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy" containerID="cri-o://9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a" gracePeriod=30
Sep 15 11:55:32.844755 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.844722    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5pvq\" (UniqueName: \"kubernetes.io/projected/87422947-e057-41f9-932a-cac136e5b405-kube-api-access-d5pvq\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:32.844978 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.844959    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:32.845078 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.845067    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87422947-e057-41f9-932a-cac136e5b405-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:32.847518 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.847471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:32.899721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.899634    2564 generic.go:356] "Generic (PLEG): container finished" podID="87422947-e057-41f9-932a-cac136e5b405" containerID="8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45" exitCode=0
Sep 15 11:55:32.899721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.899679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84" event={"ID":"87422947-e057-41f9-932a-cac136e5b405","Type":"ContainerDied","Data":"8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45"}
Sep 15 11:55:32.899721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.899692    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"
Sep 15 11:55:32.899721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.899722    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84" event={"ID":"87422947-e057-41f9-932a-cac136e5b405","Type":"ContainerDied","Data":"037fd6121373eba95e279dc863dc771fe495ec3c45f2675078bb50a7eb0e7722"}
Sep 15 11:55:32.899999 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.899744    2564 scope.go:117] "RemoveContainer" containerID="8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45"
Sep 15 11:55:32.908888 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.908856    2564 scope.go:117] "RemoveContainer" containerID="8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45"
Sep 15 11:55:32.909160 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:55:32.909142    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45\": container with ID starting with 8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45 not found: ID does not exist" containerID="8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45"
Sep 15 11:55:32.909233 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.909169    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45"} err="failed to get container status \"8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45\": rpc error: code = NotFound desc = could not find container \"8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45\": container with ID starting with 8458143fbb7ce25b17d2d777ce9c856f71e7766dca29db117aca8c6f98f31e45 not found: ID does not exist"
Sep 15 11:55:32.922451 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.921750    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"]
Sep 15 11:55:32.925195 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:32.925161    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b407aeb7-864ff86698-p7s84"]
Sep 15 11:55:33.171115 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:33.171015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:33.515005 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:33.514965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:33.612058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:33.612019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:33.713700 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:33.713663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:34.119823 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:34.119779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:34.756631 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:34.756600    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87422947-e057-41f9-932a-cac136e5b405" path="/var/lib/kubelet/pods/87422947-e057-41f9-932a-cac136e5b405/volumes"
Sep 15 11:55:34.889323 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:34.889282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:35.076560 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:35.076478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:35.663464 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:35.663436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:36.384473 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:36.384436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:37.212763 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:37.212728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:38.082473 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.082444    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:55:38.203039 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203015    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwkkc\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-kube-api-access-dwkkc\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203079    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-socket\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8428fb02-3dee-44b7-8817-381caa2bb518-istiod-ca-cert\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203173    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-credential-socket\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203200    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-data\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203479 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203243    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8428fb02-3dee-44b7-8817-381caa2bb518-istio-podinfo\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203479 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-istio-token\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203479 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203348    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-certs\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203479 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203379    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-envoy\") pod \"8428fb02-3dee-44b7-8817-381caa2bb518\" (UID: \"8428fb02-3dee-44b7-8817-381caa2bb518\") "
Sep 15 11:55:38.203687 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203526    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:38.203687 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203588    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-data" (OuterVolumeSpecName: "istio-data") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:38.203795 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203713    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:38.203854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203782    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8428fb02-3dee-44b7-8817-381caa2bb518-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:55:38.203854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203809    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.203854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203832    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.203854 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.203847    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.204082 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.204060    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:38.205733 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.205697    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8428fb02-3dee-44b7-8817-381caa2bb518-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:55:38.205733 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.205712    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-istio-token" (OuterVolumeSpecName: "istio-token") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:38.205925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.205908    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:38.205925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.205918    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-kube-api-access-dwkkc" (OuterVolumeSpecName: "kube-api-access-dwkkc") pod "8428fb02-3dee-44b7-8817-381caa2bb518" (UID: "8428fb02-3dee-44b7-8817-381caa2bb518"). InnerVolumeSpecName "kube-api-access-dwkkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:38.304432 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.304398    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.304432 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.304428    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.304432 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.304437    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8428fb02-3dee-44b7-8817-381caa2bb518-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.304859 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.304445    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwkkc\" (UniqueName: \"kubernetes.io/projected/8428fb02-3dee-44b7-8817-381caa2bb518-kube-api-access-dwkkc\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.304859 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.304456    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8428fb02-3dee-44b7-8817-381caa2bb518-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.304859 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.304464    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8428fb02-3dee-44b7-8817-381caa2bb518-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:55:38.932515 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.932475    2564 generic.go:356] "Generic (PLEG): container finished" podID="8428fb02-3dee-44b7-8817-381caa2bb518" containerID="9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a" exitCode=0
Sep 15 11:55:38.932661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.932527    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"
Sep 15 11:55:38.932661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.932554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" event={"ID":"8428fb02-3dee-44b7-8817-381caa2bb518","Type":"ContainerDied","Data":"9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a"}
Sep 15 11:55:38.932661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.932595    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl" event={"ID":"8428fb02-3dee-44b7-8817-381caa2bb518","Type":"ContainerDied","Data":"206d7e73dd06fc8cbb0b5e2fb5abb2dea402d0f000f5b0088dd090e11120e46f"}
Sep 15 11:55:38.932661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.932615    2564 scope.go:117] "RemoveContainer" containerID="9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a"
Sep 15 11:55:38.942075 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.941870    2564 scope.go:117] "RemoveContainer" containerID="6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690"
Sep 15 11:55:38.950268 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.950242    2564 scope.go:117] "RemoveContainer" containerID="9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a"
Sep 15 11:55:38.950558 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:55:38.950534    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a\": container with ID starting with 9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a not found: ID does not exist" containerID="9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a"
Sep 15 11:55:38.950609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.950571    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a"} err="failed to get container status \"9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a\": rpc error: code = NotFound desc = could not find container \"9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a\": container with ID starting with 9111bfc6c98bc17b6c23fc9d1d83e3ecc6f21b9dd35ea7568a5f3cc0ea39372a not found: ID does not exist"
Sep 15 11:55:38.950609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.950595    2564 scope.go:117] "RemoveContainer" containerID="6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690"
Sep 15 11:55:38.950830 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:55:38.950812    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690\": container with ID starting with 6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690 not found: ID does not exist" containerID="6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690"
Sep 15 11:55:38.950875 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.950837    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690"} err="failed to get container status \"6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690\": rpc error: code = NotFound desc = could not find container \"6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690\": container with ID starting with 6cff5011fd3093ebe0f3b93b435ce3428ba3d554f5527f02947f304489777690 not found: ID does not exist"
Sep 15 11:55:38.951771 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.951753    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"]
Sep 15 11:55:38.956083 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:38.956061    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl"]
Sep 15 11:55:40.190245 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:40.190171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:40.405245 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:40.405184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:40.757102 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:40.757069    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" path="/var/lib/kubelet/pods/8428fb02-3dee-44b7-8817-381caa2bb518/volumes"
Sep 15 11:55:41.261549 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:41.261519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:41.994731 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:41.994673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:42.207105 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:42.207044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:42.307493 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:42.307415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:42.407335 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:42.407305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:42.508542 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:42.508509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:43.001373 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:43.001336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:43.100521 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:43.100487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:43.431694 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:43.431595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:43.863109 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:43.863080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:44.697492 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:44.697462    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:45.492108 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:45.492071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:50.951629 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:50.951595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:51.024134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:51.024100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:51.124177 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:51.124141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:51.183257 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:51.183215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:51.536749 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:51.536709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:51.636766 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:51.636732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:52.386424 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:52.386391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:53.166903 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:53.166853    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:53.895196 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:53.895162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:54.592099 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:54.592067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:56.253560 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:56.253523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:55:57.837363 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:57.837322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:57.917078 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:57.917046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:58.102812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.102733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:58.543908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.543880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:58.848580 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.848503    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"]
Sep 15 11:55:58.848954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.848941    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy"
Sep 15 11:55:58.849001 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.848956    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy"
Sep 15 11:55:58.849001 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.848972    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy"
Sep 15 11:55:58.849001 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.848978    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy"
Sep 15 11:55:58.849001 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.848988    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87422947-e057-41f9-932a-cac136e5b405" containerName="maas-api"
Sep 15 11:55:58.849001 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.848995    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87422947-e057-41f9-932a-cac136e5b405" containerName="maas-api"
Sep 15 11:55:58.849152 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.849005    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy"
Sep 15 11:55:58.849152 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.849010    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy"
Sep 15 11:55:58.849152 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.849083    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy"
Sep 15 11:55:58.849152 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.849089    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy"
Sep 15 11:55:58.849152 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.849098    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87422947-e057-41f9-932a-cac136e5b405" containerName="maas-api"
Sep 15 11:55:58.851389 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.851369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.853984 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.853966    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-2ff8fe-openshift-default-dockercfg-q4tbf\""
Sep 15 11:55:58.863041 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.863018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"]
Sep 15 11:55:58.869420 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.869395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:58.911101 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-socket\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.911243 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-credential-socket\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.911243 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-token\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.911333 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-data\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.911333 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-envoy\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.911432 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istiod-ca-cert\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.911432 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwb2b\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-kube-api-access-bwb2b\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.911432 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-certs\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:58.911534 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:58.911459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-podinfo\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.009140 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.009096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:59.012341 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-data\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-envoy\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istiod-ca-cert\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012436 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwb2b\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-kube-api-access-bwb2b\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012591 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-certs\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012646 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-podinfo\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012705 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-socket\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012705 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-credential-socket\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012811 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-token\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.012996 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.012954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-certs\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.013080 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.013039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-socket\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.013151 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.013085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-credential-socket\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.013151 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.013143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-data\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.013326 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.013304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istiod-ca-cert\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.014727 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.014707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-envoy\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.015260 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.015242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-podinfo\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.022992 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.022967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwb2b\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-kube-api-access-bwb2b\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.026933 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.026909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-token\") pod \"e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") " pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.163030 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.162943    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:55:59.438076 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.438048    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"]
Sep 15 11:55:59.439992 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:55:59.439969    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d4a581_3afc_40a3_8172_de8fa3d6c8cf.slice/crio-b69fc9c093bf4f9014690ad52c60bce03650518a4844c747bd95abdf99df017c WatchSource:0}: Error finding container b69fc9c093bf4f9014690ad52c60bce03650518a4844c747bd95abdf99df017c: Status 404 returned error can't find the container with id b69fc9c093bf4f9014690ad52c60bce03650518a4844c747bd95abdf99df017c
Sep 15 11:55:59.442250 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.442197    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:55:59.442350 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.442297    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:55:59.442416 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:55:59.442371    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:56:00.048380 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:00.048348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" event={"ID":"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf","Type":"ContainerStarted","Data":"acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06"}
Sep 15 11:56:00.048787 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:00.048436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" event={"ID":"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf","Type":"ContainerStarted","Data":"b69fc9c093bf4f9014690ad52c60bce03650518a4844c747bd95abdf99df017c"}
Sep 15 11:56:00.073623 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:00.073576    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" podStartSLOduration=2.073560709 podStartE2EDuration="2.073560709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:55:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:00.070321252 +0000 UTC m=+1057.794062935" watchObservedRunningTime="2026-09-15 11:56:00.073560709 +0000 UTC m=+1057.797302452"
Sep 15 11:56:00.163967 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:00.163936    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:56:00.169416 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:00.169393    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:56:01.053520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:01.053483    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:56:01.054471 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:01.054453    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:56:01.884909 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:01.884871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:01.991479 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:01.991444    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:02.085206 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:02.085175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:02.808626 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:02.808593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:03.685464 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:03.685425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:04.400082 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:04.400049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:05.208696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:05.208662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:05.309960 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:05.309930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:05.487155 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:05.487080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:05.701452 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:05.701418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:05.799889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:05.799806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:08.975395 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:08.975361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:12.669230 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:12.669183    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:56:15.031515 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:15.031484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:15.141318 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:15.141239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:15.232180 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:15.232135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:23.175817 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:23.175715    2564 generic.go:356] "Generic (PLEG): container finished" podID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerID="acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06" exitCode=0
Sep 15 11:56:23.175817 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:23.175786    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" event={"ID":"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf","Type":"ContainerDied","Data":"acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06"}
Sep 15 11:56:23.176326 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:23.176206    2564 scope.go:117] "RemoveContainer" containerID="acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06"
Sep 15 11:56:23.177290 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:23.177260    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:56:23.177392 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:23.177323    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:56:23.177392 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:23.177354    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:56:24.183058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:24.183026    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" event={"ID":"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf","Type":"ContainerStarted","Data":"d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2"}
Sep 15 11:56:25.164021 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:25.163627    2564 patch_prober.go:28] interesting pod/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 15 11:56:25.164021 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:25.163691    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 15 11:56:25.164021 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:25.163954    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:56:26.163853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:26.163808    2564 patch_prober.go:28] interesting pod/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 15 11:56:26.164377 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:26.163878    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 15 11:56:27.000830 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:27.000796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:27.164415 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:27.164376    2564 patch_prober.go:28] interesting pod/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 15 11:56:27.165023 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:27.164990    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 15 11:56:27.185685 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:27.185650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:28.144961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:28.144926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:28.164329 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:28.164293    2564 patch_prober.go:28] interesting pod/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 15 11:56:28.164627 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:28.164597    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 15 11:56:28.789643 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:28.789612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:29.164025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:29.163927    2564 patch_prober.go:28] interesting pod/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 15 11:56:29.164025 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:29.164002    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 15 11:56:29.555153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:29.555112    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:30.168553 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:30.168524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:56:30.168926 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:30.168903    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:56:30.169642 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:30.169625    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:56:30.305185 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:30.305150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:30.984097 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:30.984057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:31.167584 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:31.167551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:37.481770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:37.481736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:37.542945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:37.542912    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:37.611921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:37.611878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:37.710233 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:37.710188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:47.182935 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:47.182903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:48.168402 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:48.168368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:48.952785 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:48.952747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:52.768975 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:52.768941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:56:54.659792 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:54.659755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:55.676557 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:55.676522    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:55.779638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:55.779606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:55.878520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:55.878485    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:55.979118 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:55.979085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:56.601657 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:56.601610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:56.699633 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:56.699595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:56.799541 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:56.799507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:58.219702 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:56:58.219678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:03.876806 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:03.876773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:05.196321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:05.196290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:05.297418 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:05.297379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:05.853399 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:05.853369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:12.220474 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.220441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:12.320899 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.320863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:12.445727 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.445687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:12.828425 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.828393    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"]
Sep 15 11:57:12.828896 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.828883    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy"
Sep 15 11:57:12.828948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.828901    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy"
Sep 15 11:57:12.828987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.828978    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8428fb02-3dee-44b7-8817-381caa2bb518" containerName="istio-proxy"
Sep 15 11:57:12.829027 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.828988    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9321c2e3-f5f2-4bfe-b45a-3ccb26ec25a1" containerName="istio-proxy"
Sep 15 11:57:12.832404 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.832386    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.834931 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.834906    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cdf667d8-openshift-default-dockercfg-7h2sb\""
Sep 15 11:57:12.844529 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.844498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"]
Sep 15 11:57:12.864572 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99rdv\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-kube-api-access-99rdv\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.864689 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-data\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.864689 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-credential-socket\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.864689 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-certs\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.864689 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-envoy\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.864849 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-istio-token\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.864849 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73152d65-c7e1-4208-af57-19488dc6319d-istio-podinfo\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.864925 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-socket\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.864961 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.864922    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73152d65-c7e1-4208-af57-19488dc6319d-istiod-ca-cert\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.966570 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.966540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99rdv\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-kube-api-access-99rdv\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.966768 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.966581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-data\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.966768 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.966608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-credential-socket\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.966768 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.966629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-certs\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.966768 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.966647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-envoy\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.966768 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.966712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-istio-token\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.967110 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.967072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-certs\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.967201 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.967125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73152d65-c7e1-4208-af57-19488dc6319d-istio-podinfo\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.967201 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.967138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-credential-socket\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.967400 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.967233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-socket\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.967400 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.967315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73152d65-c7e1-4208-af57-19488dc6319d-istiod-ca-cert\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.967510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.967492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-data\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.967593 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.967556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-socket\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.967995 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.967974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73152d65-c7e1-4208-af57-19488dc6319d-istiod-ca-cert\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.969717 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.969695    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73152d65-c7e1-4208-af57-19488dc6319d-istio-podinfo\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.969954 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.969927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-envoy\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.979755 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.979724    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99rdv\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-kube-api-access-99rdv\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.980250 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.980234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-istio-token\") pod \"e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") " pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:12.994055 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:12.994018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:13.083333 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:13.083245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:13.143936 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:13.143912    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:13.437784 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:13.437754    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"]
Sep 15 11:57:13.440843 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:57:13.440817    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73152d65_c7e1_4208_af57_19488dc6319d.slice/crio-c5a00c19618f318051790f92d57a5560b7aebdb14d279a59dcdc5a996c021ead WatchSource:0}: Error finding container c5a00c19618f318051790f92d57a5560b7aebdb14d279a59dcdc5a996c021ead: Status 404 returned error can't find the container with id c5a00c19618f318051790f92d57a5560b7aebdb14d279a59dcdc5a996c021ead
Sep 15 11:57:13.448018 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:13.447674    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:57:13.448018 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:13.447807    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:57:13.448018 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:13.447885    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:57:14.458737 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:14.458695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" event={"ID":"73152d65-c7e1-4208-af57-19488dc6319d","Type":"ContainerStarted","Data":"14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922"}
Sep 15 11:57:14.459204 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:14.458791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" event={"ID":"73152d65-c7e1-4208-af57-19488dc6319d","Type":"ContainerStarted","Data":"c5a00c19618f318051790f92d57a5560b7aebdb14d279a59dcdc5a996c021ead"}
Sep 15 11:57:14.504722 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:14.504673    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" podStartSLOduration=2.50465627 podStartE2EDuration="2.50465627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:57:14.501366102 +0000 UTC m=+1132.225107805" watchObservedRunningTime="2026-09-15 11:57:14.50465627 +0000 UTC m=+1132.228397956"
Sep 15 11:57:15.144562 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:15.144536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:15.149469 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:15.149448    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:15.464284 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:15.464255    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:15.465194 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:15.465176    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:19.401340 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:19.401304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:19.474844 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:19.474814    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:57:19.961236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:19.961181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:20.068987 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:20.068950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:20.170170 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:20.170133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:20.332071 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:20.331981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:21.201354 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:21.201317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:22.060714 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:22.060687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:22.784044 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:22.784007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:23.616998 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:23.616966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:24.363514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.363478    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"]
Sep 15 11:57:24.367554 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.367533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.370154 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.370132    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cdf667d8-serving-cert\""
Sep 15 11:57:24.379236 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.379194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"]
Sep 15 11:57:24.393404 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.393374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:24.494601 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.494569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:24.498884 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.498864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-metrics-certs\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.498968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.498914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.498968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.498961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-openshift-service-ca\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.499047 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.499010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gtb7\" (UniqueName: \"kubernetes.io/projected/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-kube-api-access-2gtb7\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.599905 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.599866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-metrics-certs\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.600103 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.599921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.600103 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.599943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-openshift-service-ca\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.600103 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.599995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gtb7\" (UniqueName: \"kubernetes.io/projected/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-kube-api-access-2gtb7\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.600103 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:57:24.600062    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-serving-cert: secret "maas-api-e2e-mt-cdf667d8-serving-cert" not found
Sep 15 11:57:24.600319 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:57:24.600153    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls podName:847b6e3a-8b28-4cfb-8952-7c556bec6dc5 nodeName:}" failed. No retries permitted until 2026-09-15 11:57:25.100135264 +0000 UTC m=+1142.823876940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls") pod "maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4" (UID: "847b6e3a-8b28-4cfb-8952-7c556bec6dc5") : secret "maas-api-e2e-mt-cdf667d8-serving-cert" not found
Sep 15 11:57:24.600717 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.600697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-openshift-service-ca\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.602561 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.602538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-metrics-certs\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.609379 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.609357    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gtb7\" (UniqueName: \"kubernetes.io/projected/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-kube-api-access-2gtb7\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:24.828422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.828391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:24.925523 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:24.925489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:25.003545 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:25.003517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:25.105278 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:25.105133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:25.123424 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:25.123100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls\") pod \"maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:25.280044 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:25.280013    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:25.553917 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:25.553895    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"]
Sep 15 11:57:25.556299 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:57:25.556268    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847b6e3a_8b28_4cfb_8952_7c556bec6dc5.slice/crio-4bd5057d9d3eb8c91a94039ab7bf10a35362d88b828e82a7b9fc6e9ee97a23ee WatchSource:0}: Error finding container 4bd5057d9d3eb8c91a94039ab7bf10a35362d88b828e82a7b9fc6e9ee97a23ee: Status 404 returned error can't find the container with id 4bd5057d9d3eb8c91a94039ab7bf10a35362d88b828e82a7b9fc6e9ee97a23ee
Sep 15 11:57:25.557699 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:25.557682    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:57:26.532368 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:26.532332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4" event={"ID":"847b6e3a-8b28-4cfb-8952-7c556bec6dc5","Type":"ContainerStarted","Data":"60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4"}
Sep 15 11:57:26.532539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:26.532422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4" event={"ID":"847b6e3a-8b28-4cfb-8952-7c556bec6dc5","Type":"ContainerStarted","Data":"4bd5057d9d3eb8c91a94039ab7bf10a35362d88b828e82a7b9fc6e9ee97a23ee"}
Sep 15 11:57:26.532539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:26.532469    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:26.555255 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:26.555169    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4" podStartSLOduration=2.037793787 podStartE2EDuration="2.555153658s" totalImagesPullingTime="517.359871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:57:26.5524183 +0000 UTC m=+1144.276159986" watchObservedRunningTime="2026-09-15 11:57:26.555153658 +0000 UTC m=+1144.278895376"
Sep 15 11:57:27.966989 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:27.966958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:32.544257 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:32.544208    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:57:39.590997 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:39.590964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:40.410700 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:40.410665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:41.189797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:41.189764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:41.990955 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:41.990927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:42.884859 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:42.884820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:43.596671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:43.596633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:43.672774 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:43.672740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:44.356973 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:44.356930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:44.972822 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:44.972788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:45.083782 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:45.083748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:45.631349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:45.631266    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:45.732233 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:45.732183    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:46.506442 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:46.506389    2564 patch_prober.go:28] interesting pod/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 11:57:46.506664 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:46.506479    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 11:57:46.645531 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:46.645494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:46.748572 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:46.748529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:47.517724 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:47.517692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:48.655602 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:48.655505    2564 generic.go:356] "Generic (PLEG): container finished" podID="73152d65-c7e1-4208-af57-19488dc6319d" containerID="14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922" exitCode=0
Sep 15 11:57:48.655602 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:48.655584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" event={"ID":"73152d65-c7e1-4208-af57-19488dc6319d","Type":"ContainerDied","Data":"14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922"}
Sep 15 11:57:48.656020 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:48.656005    2564 scope.go:117] "RemoveContainer" containerID="14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922"
Sep 15 11:57:48.657200 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:48.657175    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:57:48.657266 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:48.657254    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:57:48.657304 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:48.657285    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:57:49.464940 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:49.464888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:49.668310 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:49.668275    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" event={"ID":"73152d65-c7e1-4208-af57-19488dc6319d","Type":"ContainerStarted","Data":"df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6"}
Sep 15 11:57:50.102393 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.102358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:50.145067 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.145028    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:50.145339 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.145309    2564 patch_prober.go:28] interesting pod/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:57:50.145466 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.145366    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 15 11:57:50.205036 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.204998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:50.275661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.275626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:50.346116 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.346088    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:50.406474 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.406379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:50.687189 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.687158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:50.804848 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:50.804818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:51.144340 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:51.144255    2564 patch_prober.go:28] interesting pod/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:57:51.144340 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:51.144321    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 15 11:57:51.506757 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:51.506724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:52.144688 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:52.144649    2564 patch_prober.go:28] interesting pod/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:57:52.145098 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:52.144707    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 15 11:57:52.210135 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:52.210099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:52.975267 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:52.975234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:53.086513 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:53.086476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:53.144506 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:53.144467    2564 patch_prober.go:28] interesting pod/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:57:53.144703 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:53.144531    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 15 11:57:54.002496 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:54.002466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:54.062433 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:54.062391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:57:54.144268 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:54.144215    2564 patch_prober.go:28] interesting pod/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 15 11:57:54.144430 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:54.144303    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 15 11:57:54.990603 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:54.990570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:55.148579 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:55.148544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:55.149045 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:55.148946    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:55.149678 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:55.149660    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:57:55.767835 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:55.767807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:55.868086 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:55.868034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:56.695846 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:56.695817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:58.233541 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:58.233483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:59.005770 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:57:59.005738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:02.755650 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:02.755616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:03.020242 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.020147    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"]
Sep 15 11:58:03.020394 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.020373    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy" containerID="cri-o://d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2" gracePeriod=30
Sep 15 11:58:03.036053 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.036016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:03.460862 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.460811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:03.592329 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.592295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:03.712877 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.712791    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"]
Sep 15 11:58:03.715857 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.715838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.718246 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.718211    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-710ce1-openshift-default-dockercfg-56274\""
Sep 15 11:58:03.728746 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.728720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"]
Sep 15 11:58:03.742119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.742088    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:03.838907 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.838872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-token\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.839531 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.839494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-envoy\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.839756 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.839733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-credential-socket\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.840031 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.839925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzvw\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-kube-api-access-bqzvw\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.840031 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.839973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istiod-ca-cert\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.840031 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.840026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-data\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.840265 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.840115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-socket\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.840265 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.840186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-certs\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.840265 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.840242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-podinfo\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941342 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-socket\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941535 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-certs\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941535 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-podinfo\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941535 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-token\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941535 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-envoy\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941535 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-credential-socket\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzvw\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-kube-api-access-bqzvw\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istiod-ca-cert\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-data\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.941797 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-certs\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.942011 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941850    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-credential-socket\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.942011 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.941948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-socket\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.942105 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.942086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-data\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.942426 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.942408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istiod-ca-cert\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.944333 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.944312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-envoy\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.944464 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.944448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-podinfo\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.951564 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.951535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-token\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:03.951684 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:03.951623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzvw\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-kube-api-access-bqzvw\") pod \"e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") " pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:04.028517 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.028431    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:04.058403 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.058370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:04.189918 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.189884    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"]
Sep 15 11:58:04.190133 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.190083    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4" podUID="847b6e3a-8b28-4cfb-8952-7c556bec6dc5" containerName="maas-api" containerID="cri-o://60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4" gracePeriod=30
Sep 15 11:58:04.213619 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.213584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:04.287761 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.287657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:04.305212 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.305181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"]
Sep 15 11:58:04.306592 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:58:04.306567    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e2c0e8_f29b_4839_8941_97261d8c57ab.slice/crio-3f2e7ee9df7d3c46487c7bd60b6e2fc8fa748f8574ac0de6ec3b9979b50199a8 WatchSource:0}: Error finding container 3f2e7ee9df7d3c46487c7bd60b6e2fc8fa748f8574ac0de6ec3b9979b50199a8: Status 404 returned error can't find the container with id 3f2e7ee9df7d3c46487c7bd60b6e2fc8fa748f8574ac0de6ec3b9979b50199a8
Sep 15 11:58:04.309046 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.309014    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:04.309128 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.309081    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:04.309128 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.309110    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:04.351635 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.351594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:04.445271 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.445240    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:58:04.450891 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.450866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:04.549379 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.549293    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-metrics-certs\") pod \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") "
Sep 15 11:58:04.549552 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.549453    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls\") pod \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") "
Sep 15 11:58:04.549552 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.549504    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-openshift-service-ca\") pod \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") "
Sep 15 11:58:04.549665 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.549595    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gtb7\" (UniqueName: \"kubernetes.io/projected/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-kube-api-access-2gtb7\") pod \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\" (UID: \"847b6e3a-8b28-4cfb-8952-7c556bec6dc5\") "
Sep 15 11:58:04.550381 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.550351    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "847b6e3a-8b28-4cfb-8952-7c556bec6dc5" (UID: "847b6e3a-8b28-4cfb-8952-7c556bec6dc5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:04.551057 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.551030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:04.551968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.551939    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-kube-api-access-2gtb7" (OuterVolumeSpecName: "kube-api-access-2gtb7") pod "847b6e3a-8b28-4cfb-8952-7c556bec6dc5" (UID: "847b6e3a-8b28-4cfb-8952-7c556bec6dc5"). InnerVolumeSpecName "kube-api-access-2gtb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:04.551968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.551957    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "847b6e3a-8b28-4cfb-8952-7c556bec6dc5" (UID: "847b6e3a-8b28-4cfb-8952-7c556bec6dc5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:04.552119 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.552019    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "847b6e3a-8b28-4cfb-8952-7c556bec6dc5" (UID: "847b6e3a-8b28-4cfb-8952-7c556bec6dc5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:04.651649 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.651613    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:04.651649 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.651641    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gtb7\" (UniqueName: \"kubernetes.io/projected/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-kube-api-access-2gtb7\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:04.651649 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.651650    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:04.651871 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.651659    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b6e3a-8b28-4cfb-8952-7c556bec6dc5-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:04.758802 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.758761    2564 generic.go:356] "Generic (PLEG): container finished" podID="847b6e3a-8b28-4cfb-8952-7c556bec6dc5" containerID="60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4" exitCode=0
Sep 15 11:58:04.758996 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.758871    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"
Sep 15 11:58:04.759130 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.759104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4" event={"ID":"847b6e3a-8b28-4cfb-8952-7c556bec6dc5","Type":"ContainerDied","Data":"60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4"}
Sep 15 11:58:04.759245 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.759161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4" event={"ID":"847b6e3a-8b28-4cfb-8952-7c556bec6dc5","Type":"ContainerDied","Data":"4bd5057d9d3eb8c91a94039ab7bf10a35362d88b828e82a7b9fc6e9ee97a23ee"}
Sep 15 11:58:04.759245 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.759197    2564 scope.go:117] "RemoveContainer" containerID="60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4"
Sep 15 11:58:04.762929 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.762119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm" event={"ID":"e3e2c0e8-f29b-4839-8941-97261d8c57ab","Type":"ContainerStarted","Data":"38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1"}
Sep 15 11:58:04.762929 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.762169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm" event={"ID":"e3e2c0e8-f29b-4839-8941-97261d8c57ab","Type":"ContainerStarted","Data":"3f2e7ee9df7d3c46487c7bd60b6e2fc8fa748f8574ac0de6ec3b9979b50199a8"}
Sep 15 11:58:04.774143 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.774121    2564 scope.go:117] "RemoveContainer" containerID="60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4"
Sep 15 11:58:04.774521 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:58:04.774491    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4\": container with ID starting with 60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4 not found: ID does not exist" containerID="60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4"
Sep 15 11:58:04.774607 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.774532    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4"} err="failed to get container status \"60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4\": rpc error: code = NotFound desc = could not find container \"60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4\": container with ID starting with 60b969187550b1074bf25797f4af682df5fb9f65ed6d41c72c86ee667f775bb4 not found: ID does not exist"
Sep 15 11:58:04.787939 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.787745    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm" podStartSLOduration=1.787725613 podStartE2EDuration="1.787725613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:58:04.784830976 +0000 UTC m=+1182.508572664" watchObservedRunningTime="2026-09-15 11:58:04.787725613 +0000 UTC m=+1182.511467502"
Sep 15 11:58:04.793663 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.793637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:04.807838 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.807767    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"]
Sep 15 11:58:04.810533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.810514    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf667d8-b9995c9f8-swgp4"]
Sep 15 11:58:04.902706 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:04.902675    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:05.028696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:05.028664    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:05.033541 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:05.033519    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:05.109595 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:05.109519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:05.210543 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:05.210516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:05.314729 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:05.314693    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:05.769256 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:05.769228    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:05.770175 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:05.770158    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:58:05.783455 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:05.783427    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:06.611279 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:06.611249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:06.757314 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:06.757279    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847b6e3a-8b28-4cfb-8952-7c556bec6dc5" path="/var/lib/kubelet/pods/847b6e3a-8b28-4cfb-8952-7c556bec6dc5/volumes"
Sep 15 11:58:07.376099 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:07.376061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:08.267422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.267399    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:58:08.289231 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289140    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-token\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289368 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289237    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-socket\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289368 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289262    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-data\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289368 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289292    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-podinfo\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289368 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289332    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istiod-ca-cert\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289590 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289391    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwb2b\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-kube-api-access-bwb2b\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289590 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-certs\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289590 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289474    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-credential-socket\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289590 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289562    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-envoy\") pod \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\" (UID: \"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf\") "
Sep 15 11:58:08.289804 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289776    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:08.289928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.289908    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.290257 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.290127    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:08.290257 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.290196    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:08.290425 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.290273    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:08.290425 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.290409    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:08.291674 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.291643    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:08.292166 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.292136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-kube-api-access-bwb2b" (OuterVolumeSpecName: "kube-api-access-bwb2b") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "kube-api-access-bwb2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:08.292544 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.292516    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:58:08.292749 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.292730    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" (UID: "f6d4a581-3afc-40a3-8172-de8fa3d6c8cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:08.390928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.390894    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.390928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.390921    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.390928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.390930    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.390928 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.390937    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.391188 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.390946    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.391188 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.390954    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwb2b\" (UniqueName: \"kubernetes.io/projected/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-kube-api-access-bwb2b\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.391188 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.390963    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.391188 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.390970    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:08.786620 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.786588    2564 generic.go:356] "Generic (PLEG): container finished" podID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerID="d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2" exitCode=0
Sep 15 11:58:08.786793 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.786643    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"
Sep 15 11:58:08.786793 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.786657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" event={"ID":"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf","Type":"ContainerDied","Data":"d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2"}
Sep 15 11:58:08.786793 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.786698    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n" event={"ID":"f6d4a581-3afc-40a3-8172-de8fa3d6c8cf","Type":"ContainerDied","Data":"b69fc9c093bf4f9014690ad52c60bce03650518a4844c747bd95abdf99df017c"}
Sep 15 11:58:08.786793 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.786719    2564 scope.go:117] "RemoveContainer" containerID="d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2"
Sep 15 11:58:08.795697 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.795677    2564 scope.go:117] "RemoveContainer" containerID="acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06"
Sep 15 11:58:08.803575 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.803555    2564 scope.go:117] "RemoveContainer" containerID="d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2"
Sep 15 11:58:08.803851 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:58:08.803833    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2\": container with ID starting with d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2 not found: ID does not exist" containerID="d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2"
Sep 15 11:58:08.803912 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.803857    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2"} err="failed to get container status \"d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2\": rpc error: code = NotFound desc = could not find container \"d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2\": container with ID starting with d3ec001fdf8cfabc04efb34bfe65d187f6a85e53f744efdafc75e1b22b004eb2 not found: ID does not exist"
Sep 15 11:58:08.803912 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.803873    2564 scope.go:117] "RemoveContainer" containerID="acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06"
Sep 15 11:58:08.804119 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:58:08.804101    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06\": container with ID starting with acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06 not found: ID does not exist" containerID="acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06"
Sep 15 11:58:08.804172 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.804129    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06"} err="failed to get container status \"acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06\": rpc error: code = NotFound desc = could not find container \"acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06\": container with ID starting with acbcf162a70db5f06baf9314db03fa8eb4990584dc5b46dfec58114a7fef4f06 not found: ID does not exist"
Sep 15 11:58:08.826726 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.826701    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"]
Sep 15 11:58:08.833519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.833498    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n"]
Sep 15 11:58:08.930597 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:08.930558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:10.756566 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:10.756529    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" path="/var/lib/kubelet/pods/f6d4a581-3afc-40a3-8172-de8fa3d6c8cf/volumes"
Sep 15 11:58:12.093085 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:12.093050    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"]
Sep 15 11:58:12.093565 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:12.093386    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy" containerID="cri-o://df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6" gracePeriod=30
Sep 15 11:58:12.683519 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:12.683479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:12.783539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:12.783503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:14.679882 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:14.679845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:17.346403 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.346379    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:58:17.486099 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486070    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-envoy\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486099 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486103    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-certs\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486365 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486120    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-socket\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486365 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486241    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99rdv\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-kube-api-access-99rdv\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486365 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486295    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73152d65-c7e1-4208-af57-19488dc6319d-istiod-ca-cert\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486365 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486334    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-credential-socket\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486365 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486356    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-istio-token\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486382    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:17.486640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-data\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486465    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73152d65-c7e1-4208-af57-19488dc6319d-istio-podinfo\") pod \"73152d65-c7e1-4208-af57-19488dc6319d\" (UID: \"73152d65-c7e1-4208-af57-19488dc6319d\") "
Sep 15 11:58:17.486640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486493    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:17.486640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486618    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:17.486887 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-data" (OuterVolumeSpecName: "istio-data") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:17.486887 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73152d65-c7e1-4208-af57-19488dc6319d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:17.487009 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.486992    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73152d65-c7e1-4208-af57-19488dc6319d-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.487062 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.487013    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.487062 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.487027    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.487062 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.487040    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.487062 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.487053    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.488521 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.488501    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-istio-token" (OuterVolumeSpecName: "istio-token") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:17.488674 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.488658    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73152d65-c7e1-4208-af57-19488dc6319d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:58:17.488733 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.488703    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:58:17.488786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.488770    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-kube-api-access-99rdv" (OuterVolumeSpecName: "kube-api-access-99rdv") pod "73152d65-c7e1-4208-af57-19488dc6319d" (UID: "73152d65-c7e1-4208-af57-19488dc6319d"). InnerVolumeSpecName "kube-api-access-99rdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:17.589449 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.588198    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.589449 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.588264    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73152d65-c7e1-4208-af57-19488dc6319d-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.595298 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.595259    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73152d65-c7e1-4208-af57-19488dc6319d-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.595514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.595368    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99rdv\" (UniqueName: \"kubernetes.io/projected/73152d65-c7e1-4208-af57-19488dc6319d-kube-api-access-99rdv\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:58:17.837490 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.837396    2564 generic.go:356] "Generic (PLEG): container finished" podID="73152d65-c7e1-4208-af57-19488dc6319d" containerID="df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6" exitCode=0
Sep 15 11:58:17.837490 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.837459    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"
Sep 15 11:58:17.837703 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.837481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" event={"ID":"73152d65-c7e1-4208-af57-19488dc6319d","Type":"ContainerDied","Data":"df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6"}
Sep 15 11:58:17.837703 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.837537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8" event={"ID":"73152d65-c7e1-4208-af57-19488dc6319d","Type":"ContainerDied","Data":"c5a00c19618f318051790f92d57a5560b7aebdb14d279a59dcdc5a996c021ead"}
Sep 15 11:58:17.837703 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.837561    2564 scope.go:117] "RemoveContainer" containerID="df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6"
Sep 15 11:58:17.847105 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.847086    2564 scope.go:117] "RemoveContainer" containerID="14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922"
Sep 15 11:58:17.855827 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.855808    2564 scope.go:117] "RemoveContainer" containerID="df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6"
Sep 15 11:58:17.856092 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:58:17.856074    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6\": container with ID starting with df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6 not found: ID does not exist" containerID="df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6"
Sep 15 11:58:17.856134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.856101    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6"} err="failed to get container status \"df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6\": rpc error: code = NotFound desc = could not find container \"df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6\": container with ID starting with df8864257d0e34070a24ea071d413c494a409db6b7ea47b93637dfc8bdb801c6 not found: ID does not exist"
Sep 15 11:58:17.856134 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.856117    2564 scope.go:117] "RemoveContainer" containerID="14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922"
Sep 15 11:58:17.856401 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:58:17.856383    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922\": container with ID starting with 14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922 not found: ID does not exist" containerID="14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922"
Sep 15 11:58:17.856443 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.856410    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922"} err="failed to get container status \"14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922\": rpc error: code = NotFound desc = could not find container \"14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922\": container with ID starting with 14d3749115c5b14cdfe737eef08b1e86e95036fdd27d0aba87706c5d7084e922 not found: ID does not exist"
Sep 15 11:58:17.860140 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.860119    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"]
Sep 15 11:58:17.864366 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:17.864348    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8"]
Sep 15 11:58:18.756644 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:18.756613    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73152d65-c7e1-4208-af57-19488dc6319d" path="/var/lib/kubelet/pods/73152d65-c7e1-4208-af57-19488dc6319d/volumes"
Sep 15 11:58:19.048743 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:19.048664    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:19.171761 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:19.171732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:19.268765 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:19.268714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:19.398635 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:19.398557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:20.426066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:20.426030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:25.293978 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:25.293927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:25.661902 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:25.661807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:25.765811 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:25.765775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:26.765259 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.765211    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:58:26.817970 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.817940    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"]
Sep 15 11:58:26.818599 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818583    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy"
Sep 15 11:58:26.818654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818601    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy"
Sep 15 11:58:26.818654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818624    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy"
Sep 15 11:58:26.818654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818632    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy"
Sep 15 11:58:26.818654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818643    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy"
Sep 15 11:58:26.818654 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818652    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy"
Sep 15 11:58:26.818805 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818683    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847b6e3a-8b28-4cfb-8952-7c556bec6dc5" containerName="maas-api"
Sep 15 11:58:26.818805 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818693    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="847b6e3a-8b28-4cfb-8952-7c556bec6dc5" containerName="maas-api"
Sep 15 11:58:26.818805 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818787    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="847b6e3a-8b28-4cfb-8952-7c556bec6dc5" containerName="maas-api"
Sep 15 11:58:26.818805 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818804    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy"
Sep 15 11:58:26.818968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818816    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy"
Sep 15 11:58:26.818968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818827    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d4a581-3afc-40a3-8172-de8fa3d6c8cf" containerName="istio-proxy"
Sep 15 11:58:26.818968 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.818836    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy"
Sep 15 11:58:26.823520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.823500    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:26.825900 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.825870    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-ec8230-openshift-default-dockercfg-gf2c8\""
Sep 15 11:58:26.835277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:26.835255    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"]
Sep 15 11:58:27.004006 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.003962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-socket\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.004006 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.004008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-certs\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.004291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.004072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpnw\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-kube-api-access-ljpnw\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.004291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.004190    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-data\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.004291 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.004254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-envoy\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.004422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.004312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-credential-socket\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.004422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.004374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istiod-ca-cert\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.004422 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.004403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-podinfo\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.004539 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.004447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-token\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.105582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istiod-ca-cert\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.105582 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-podinfo\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.105813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-token\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.105813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-socket\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.105813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-certs\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.105813 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpnw\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-kube-api-access-ljpnw\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.106037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-data\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.106037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-envoy\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.106037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.105889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-credential-socket\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.106037 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.106023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-socket\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.106283 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.106069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-certs\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.106283 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.106253    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-data\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.106283 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.106275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-credential-socket\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.106421 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.106285    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istiod-ca-cert\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.108088 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.108052    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-envoy\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.108501 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.108479    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-podinfo\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.114984 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.114961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-token\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.115311 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.115291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpnw\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-kube-api-access-ljpnw\") pod \"e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") " pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.136297 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.136277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:27.264731 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.264698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:27.365698 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.365606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:27.412804 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.412779    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"]
Sep 15 11:58:27.414926 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:58:27.414898    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1c6eca_19b8_4e31_99df_10104f9be4fc.slice/crio-23c9ac9306cf65f06c4c54677e0a9a0ba7eb0c9fd976a88326883411970db92a WatchSource:0}: Error finding container 23c9ac9306cf65f06c4c54677e0a9a0ba7eb0c9fd976a88326883411970db92a: Status 404 returned error can't find the container with id 23c9ac9306cf65f06c4c54677e0a9a0ba7eb0c9fd976a88326883411970db92a
Sep 15 11:58:27.417355 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.417319    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:27.417470 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.417397    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:27.417470 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.417442    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:27.895621 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.895582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" event={"ID":"ea1c6eca-19b8-4e31-99df-10104f9be4fc","Type":"ContainerStarted","Data":"cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c"}
Sep 15 11:58:27.895971 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.895635    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" event={"ID":"ea1c6eca-19b8-4e31-99df-10104f9be4fc","Type":"ContainerStarted","Data":"23c9ac9306cf65f06c4c54677e0a9a0ba7eb0c9fd976a88326883411970db92a"}
Sep 15 11:58:27.916179 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:27.916111    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podStartSLOduration=1.9160932480000001 podStartE2EDuration="1.916093248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:58:27.916040467 +0000 UTC m=+1205.639782154" watchObservedRunningTime="2026-09-15 11:58:27.916093248 +0000 UTC m=+1205.639834936"
Sep 15 11:58:28.136670 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:28.136634    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:28.141464 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:28.141441    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:28.901441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:28.901410    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:28.902305 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:28.902289    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:29.388538 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:29.388498    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:29.816568 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:29.816529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:29.916441 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:29.916411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:30.281998 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:30.281967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:31.115133 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:31.115095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:31.885738 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:31.885701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:32.901372 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:32.901334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:33.630574 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:33.630543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:33.732349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:33.732321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:34.132206 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:34.132172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:34.210594 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:34.210565    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:41.048192 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.048162    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"]
Sep 15 11:58:41.048609 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.048595    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy"
Sep 15 11:58:41.048653 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.048610    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73152d65-c7e1-4208-af57-19488dc6319d" containerName="istio-proxy"
Sep 15 11:58:41.053001 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.052987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.055671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.055649    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-710ce1\"/\"kube-root-ca.crt\""
Sep 15 11:58:41.055773 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.055678    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-710ce1\"/\"openshift-service-ca.crt\""
Sep 15 11:58:41.056718 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.056701    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-710ce1\"/\"noten-model-710ce1-kserve-self-signed-certs\""
Sep 15 11:58:41.056812 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.056727    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-710ce1\"/\"default-dockercfg-s6xz7\""
Sep 15 11:58:41.066943 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.060958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"]
Sep 15 11:58:41.147650 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.147622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czx44\" (UniqueName: \"kubernetes.io/projected/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-kube-api-access-czx44\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.147775 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.147656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tls-certs\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.147775 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.147684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-dshm\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.147916 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.147824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-home\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.147916 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.147875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tmp-dir\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.148018 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.147945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-model-cache\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.249614 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.249569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-home\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.250438 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.250304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-home\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.250867 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.250831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tmp-dir\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.251004 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.250984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tmp-dir\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.251214 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.251192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-model-cache\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.251691 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.251584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-model-cache\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.251835 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.251816    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czx44\" (UniqueName: \"kubernetes.io/projected/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-kube-api-access-czx44\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.252349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.252331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tls-certs\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.252935 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.252918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-dshm\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.256183 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.256135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tls-certs\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.259408 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.259376    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-dshm\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.263948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.263904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czx44\" (UniqueName: \"kubernetes.io/projected/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-kube-api-access-czx44\") pod \"noten-model-710ce1-kserve-7bd898888c-62js4\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") " pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.350745 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.350664    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:41.370759 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.370732    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:41.652164 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.652131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"]
Sep 15 11:58:41.653652 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:58:41.653616    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8f17e09_4498_4e8f_a11b_efbbf302dbf6.slice/crio-3719b7159bb3b5c6f8c889dae5ded55a2ca259ba1fc37ea92a9f00b4a8f20830 WatchSource:0}: Error finding container 3719b7159bb3b5c6f8c889dae5ded55a2ca259ba1fc37ea92a9f00b4a8f20830: Status 404 returned error can't find the container with id 3719b7159bb3b5c6f8c889dae5ded55a2ca259ba1fc37ea92a9f00b4a8f20830
Sep 15 11:58:41.970887 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.970856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4" event={"ID":"f8f17e09-4498-4e8f-a11b-efbbf302dbf6","Type":"ContainerStarted","Data":"420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344"}
Sep 15 11:58:41.971048 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.970896    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4" event={"ID":"f8f17e09-4498-4e8f-a11b-efbbf302dbf6","Type":"ContainerStarted","Data":"3719b7159bb3b5c6f8c889dae5ded55a2ca259ba1fc37ea92a9f00b4a8f20830"}
Sep 15 11:58:41.991527 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:41.991481    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4" podStartSLOduration=0.991465265 podStartE2EDuration="991.465265ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:58:41.987666806 +0000 UTC m=+1219.711408515" watchObservedRunningTime="2026-09-15 11:58:41.991465265 +0000 UTC m=+1219.715206951"
Sep 15 11:58:42.361485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:42.361399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:51.371282 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:51.371247    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:51.371657 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:51.371294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:51.384086 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:51.384027    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:52.025514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:52.025484    2564 generic.go:356] "Generic (PLEG): container finished" podID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerID="cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c" exitCode=0
Sep 15 11:58:52.025690 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:52.025555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" event={"ID":"ea1c6eca-19b8-4e31-99df-10104f9be4fc","Type":"ContainerDied","Data":"cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c"}
Sep 15 11:58:52.025993 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:52.025968    2564 scope.go:117] "RemoveContainer" containerID="cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c"
Sep 15 11:58:52.027016 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:52.026987    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:52.027084 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:52.027055    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:52.027124 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:52.027088    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:58:52.037555 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:52.037537    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:58:53.033288 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:53.033253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" event={"ID":"ea1c6eca-19b8-4e31-99df-10104f9be4fc","Type":"ContainerStarted","Data":"6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e"}
Sep 15 11:58:53.136899 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:53.136870    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:53.137075 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:53.137055    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 11:58:53.137127 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:53.137099    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 11:58:54.137576 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:54.137537    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 11:58:54.138011 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:54.137600    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 11:58:54.564573 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:54.564530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:55.137202 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:55.137161    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 11:58:55.137420 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:55.137251    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 11:58:56.039419 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:56.039386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:56.137432 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:56.137399    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 11:58:56.137623 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:56.137458    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 11:58:56.858901 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:56.858862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:57.137688 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:57.137607    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 11:58:57.137688 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:57.137662    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 11:58:57.584927 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:57.584891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:58.137632 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:58.137597    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 11:58:58.137846 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:58.137662    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 11:58:58.399443 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:58.399332    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:58.902187 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:58.902154    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:59.114605 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:59.114563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:59.141549 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:59.141522    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:59.142496 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:59.142479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 11:58:59.259502 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:59.259473    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:58:59.848619 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:59.848561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:59.949529 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:58:59.949495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:00.178339 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.178259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:00.442483 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.442451    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"]
Sep 15 11:59:00.447285 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.447233    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.449661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.449641    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-6dca39-openshift-default-dockercfg-kmdkn\""
Sep 15 11:59:00.457900 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.457880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"]
Sep 15 11:59:00.472597 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.472569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:00.568864 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.568823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-data\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.569066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.568870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-token\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.569066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.568927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-socket\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.569066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.568977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istiod-ca-cert\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.569066 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.569020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-podinfo\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.569311 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.569105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zchf2\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-kube-api-access-zchf2\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.569311 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.569154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-envoy\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.569311 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.569208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-certs\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.569311 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.569259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-credential-socket\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.620523 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.620489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:00.670707 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istiod-ca-cert\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.670853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-podinfo\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.670853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zchf2\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-kube-api-access-zchf2\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.670853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-envoy\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.670853 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-certs\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-credential-socket\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-data\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-token\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671069 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.670983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-socket\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671339 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.671318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-socket\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671402 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.671374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-credential-socket\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671453 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.671435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-data\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671551 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.671529    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istiod-ca-cert\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.671592 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.671552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-certs\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.673153 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.673135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-envoy\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.673516 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.673471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-podinfo\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.685541 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.685503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-token\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.685721 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.685685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zchf2\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-kube-api-access-zchf2\") pod \"e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") " pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:00.762349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:00.762270    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:01.043501 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:01.043471    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"]
Sep 15 11:59:01.044717 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:59:01.044694    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65c77a3_003e_4e40_998e_aa79fc2d2f39.slice/crio-dcc5653700693baed7ac77d09b4be9033ca9c93b902a8ecbcae99da2b0587f79 WatchSource:0}: Error finding container dcc5653700693baed7ac77d09b4be9033ca9c93b902a8ecbcae99da2b0587f79: Status 404 returned error can't find the container with id dcc5653700693baed7ac77d09b4be9033ca9c93b902a8ecbcae99da2b0587f79
Sep 15 11:59:01.047000 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:01.046967    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:01.047058 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:01.047033    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:01.047094 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:01.047062    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:01.084681 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:01.084645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" event={"ID":"d65c77a3-003e-4e40-998e-aa79fc2d2f39","Type":"ContainerStarted","Data":"dcc5653700693baed7ac77d09b4be9033ca9c93b902a8ecbcae99da2b0587f79"}
Sep 15 11:59:02.092275 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:02.092212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" event={"ID":"d65c77a3-003e-4e40-998e-aa79fc2d2f39","Type":"ContainerStarted","Data":"e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c"}
Sep 15 11:59:02.117881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:02.117823    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" podStartSLOduration=2.11780553 podStartE2EDuration="2.11780553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:59:02.115178185 +0000 UTC m=+1239.838919874" watchObservedRunningTime="2026-09-15 11:59:02.11780553 +0000 UTC m=+1239.841547216"
Sep 15 11:59:02.763366 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:02.763339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:02.768670 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:02.768645    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:03.098386 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:03.098301    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:03.099245 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:03.099207    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:03.324585 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:03.324549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:04.044697 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:04.044656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:04.151344 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:04.151315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:04.499625 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:04.499597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:05.512464 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:05.512419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:06.392839 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:06.392801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:07.171694 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:07.171661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:07.931088 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:07.931056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:08.819063 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:08.819029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:08.917892 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:08.917857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:08.978194 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:08.978133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:09.349030 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:09.348982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:09.449799 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:09.449759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:12.828857 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:12.828817    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"]
Sep 15 11:59:12.829359 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:12.829017    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm" podUID="e3e2c0e8-f29b-4839-8941-97261d8c57ab" containerName="istio-proxy" containerID="cri-o://38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1" gracePeriod=30
Sep 15 11:59:12.853340 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:12.853310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:13.067696 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:13.067656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:13.176462 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:13.176374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:18.098784 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.098725    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:59:18.155460 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155429    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-podinfo\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.155671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155515    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-envoy\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.155671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155549    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-token\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.155671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155583    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-credential-socket\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.155671 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155627    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqzvw\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-kube-api-access-bqzvw\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.155902 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155694    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-certs\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.155902 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155752    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-data\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.155902 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155785    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istiod-ca-cert\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.155902 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155818    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-socket\") pod \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\" (UID: \"e3e2c0e8-f29b-4839-8941-97261d8c57ab\") "
Sep 15 11:59:18.156939 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.156633    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:18.156939 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.156474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:18.156939 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.156834    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:18.157193 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.157095    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:59:18.157193 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.157179    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.157786 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.155904    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:18.158881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.158837    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:18.158881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.158854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:59:18.158881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.158843    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:18.158881 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.158848    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-kube-api-access-bqzvw" (OuterVolumeSpecName: "kube-api-access-bqzvw") pod "e3e2c0e8-f29b-4839-8941-97261d8c57ab" (UID: "e3e2c0e8-f29b-4839-8941-97261d8c57ab"). InnerVolumeSpecName "kube-api-access-bqzvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:18.161848 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.161128    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"]
Sep 15 11:59:18.184640 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.184614    2564 generic.go:356] "Generic (PLEG): container finished" podID="e3e2c0e8-f29b-4839-8941-97261d8c57ab" containerID="38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1" exitCode=0
Sep 15 11:59:18.184785 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.184664    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"
Sep 15 11:59:18.184785 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.184703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm" event={"ID":"e3e2c0e8-f29b-4839-8941-97261d8c57ab","Type":"ContainerDied","Data":"38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1"}
Sep 15 11:59:18.184785 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.184764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm" event={"ID":"e3e2c0e8-f29b-4839-8941-97261d8c57ab","Type":"ContainerDied","Data":"3f2e7ee9df7d3c46487c7bd60b6e2fc8fa748f8574ac0de6ec3b9979b50199a8"}
Sep 15 11:59:18.184948 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.184792    2564 scope.go:117] "RemoveContainer" containerID="38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1"
Sep 15 11:59:18.194366 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.194347    2564 scope.go:117] "RemoveContainer" containerID="38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1"
Sep 15 11:59:18.194636 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:59:18.194617    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1\": container with ID starting with 38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1 not found: ID does not exist" containerID="38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1"
Sep 15 11:59:18.194685 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.194644    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1"} err="failed to get container status \"38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1\": rpc error: code = NotFound desc = could not find container \"38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1\": container with ID starting with 38c1ddbcdd148b0176d0dbe41896e044a1ddcfe719de180e6eac39b865a5a4c1 not found: ID does not exist"
Sep 15 11:59:18.209170 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.209141    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"]
Sep 15 11:59:18.214023 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.213965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:18.214169 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.214102    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm"]
Sep 15 11:59:18.257908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.257882    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.257908 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.257906    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.258064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.257914    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.258064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.257922    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.258064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.257931    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqzvw\" (UniqueName: \"kubernetes.io/projected/e3e2c0e8-f29b-4839-8941-97261d8c57ab-kube-api-access-bqzvw\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.258064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.257940    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.258064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.257949    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3e2c0e8-f29b-4839-8941-97261d8c57ab-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.258064 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.257957    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3e2c0e8-f29b-4839-8941-97261d8c57ab-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:18.761958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:18.761910    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3e2c0e8-f29b-4839-8941-97261d8c57ab" path="/var/lib/kubelet/pods/e3e2c0e8-f29b-4839-8941-97261d8c57ab/volumes"
Sep 15 11:59:25.681807 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:25.681768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:27.239008 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:27.238976    2564 generic.go:356] "Generic (PLEG): container finished" podID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerID="e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c" exitCode=0
Sep 15 11:59:27.239427 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:27.239048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" event={"ID":"d65c77a3-003e-4e40-998e-aa79fc2d2f39","Type":"ContainerDied","Data":"e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c"}
Sep 15 11:59:27.239499 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:27.239485    2564 scope.go:117] "RemoveContainer" containerID="e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c"
Sep 15 11:59:27.240694 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:27.240667    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:27.240765 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:27.240735    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:27.240805 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:27.240766    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:28.246277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:28.246237    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" event={"ID":"d65c77a3-003e-4e40-998e-aa79fc2d2f39","Type":"ContainerStarted","Data":"8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671"}
Sep 15 11:59:28.762821 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:28.762783    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:28.764193 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:28.764161    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:59:28.764346 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:28.764237    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:59:29.763077 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:29.763034    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:59:29.763623 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:29.763120    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:59:30.763174 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:30.763131    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:59:30.763672 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:30.763197    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:59:30.904189 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:30.904154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:31.763047 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:31.762998    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:59:31.763286 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:31.763090    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:59:32.763575 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:32.763532    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:59:32.764087 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:32.763606    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 11:59:33.099270 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.099177    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:33.187897 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.187846    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4" podUID="f8f17e09-4498-4e8f-a11b-efbbf302dbf6" containerName="main" containerID="cri-o://420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344" gracePeriod=45
Sep 15 11:59:33.446481 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.446452    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:59:33.571923 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.571878    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 11:59:33.619927 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.619894    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czx44\" (UniqueName: \"kubernetes.io/projected/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-kube-api-access-czx44\") pod \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") "
Sep 15 11:59:33.619927 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.619928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tmp-dir\") pod \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") "
Sep 15 11:59:33.620135 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.619974    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-dshm\") pod \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") "
Sep 15 11:59:33.620135 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tls-certs\") pod \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") "
Sep 15 11:59:33.620135 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620074    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-model-cache\") pod \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") "
Sep 15 11:59:33.620277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620161    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-home\") pod \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\" (UID: \"f8f17e09-4498-4e8f-a11b-efbbf302dbf6\") "
Sep 15 11:59:33.620277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620188    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f8f17e09-4498-4e8f-a11b-efbbf302dbf6" (UID: "f8f17e09-4498-4e8f-a11b-efbbf302dbf6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:33.620440 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-model-cache" (OuterVolumeSpecName: "model-cache") pod "f8f17e09-4498-4e8f-a11b-efbbf302dbf6" (UID: "f8f17e09-4498-4e8f-a11b-efbbf302dbf6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:33.620566 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620461    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-home" (OuterVolumeSpecName: "home") pod "f8f17e09-4498-4e8f-a11b-efbbf302dbf6" (UID: "f8f17e09-4498-4e8f-a11b-efbbf302dbf6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:33.620566 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620544    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-model-cache\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:33.620566 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620556    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-home\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:33.620566 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.620566    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tmp-dir\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:33.622232 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.622197    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-dshm" (OuterVolumeSpecName: "dshm") pod "f8f17e09-4498-4e8f-a11b-efbbf302dbf6" (UID: "f8f17e09-4498-4e8f-a11b-efbbf302dbf6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:33.622530 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.622513    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f8f17e09-4498-4e8f-a11b-efbbf302dbf6" (UID: "f8f17e09-4498-4e8f-a11b-efbbf302dbf6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:59:33.622579 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.622543    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-kube-api-access-czx44" (OuterVolumeSpecName: "kube-api-access-czx44") pod "f8f17e09-4498-4e8f-a11b-efbbf302dbf6" (UID: "f8f17e09-4498-4e8f-a11b-efbbf302dbf6"). InnerVolumeSpecName "kube-api-access-czx44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:33.721520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.721489    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czx44\" (UniqueName: \"kubernetes.io/projected/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-kube-api-access-czx44\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:33.721520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.721516    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-dshm\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:33.721520 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.721527    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f17e09-4498-4e8f-a11b-efbbf302dbf6-tls-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 11:59:33.766890 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.766859    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:33.767970 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:33.767950    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 11:59:34.292420 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.292391    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8f17e09-4498-4e8f-a11b-efbbf302dbf6" containerID="420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344" exitCode=0
Sep 15 11:59:34.292606 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.292437    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"
Sep 15 11:59:34.292606 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.292476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4" event={"ID":"f8f17e09-4498-4e8f-a11b-efbbf302dbf6","Type":"ContainerDied","Data":"420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344"}
Sep 15 11:59:34.292606 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.292515    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4" event={"ID":"f8f17e09-4498-4e8f-a11b-efbbf302dbf6","Type":"ContainerDied","Data":"3719b7159bb3b5c6f8c889dae5ded55a2ca259ba1fc37ea92a9f00b4a8f20830"}
Sep 15 11:59:34.292606 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.292540    2564 scope.go:117] "RemoveContainer" containerID="420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344"
Sep 15 11:59:34.302434 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.302416    2564 scope.go:117] "RemoveContainer" containerID="420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344"
Sep 15 11:59:34.302704 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:59:34.302686    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344\": container with ID starting with 420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344 not found: ID does not exist" containerID="420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344"
Sep 15 11:59:34.302763 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.302712    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344"} err="failed to get container status \"420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344\": rpc error: code = NotFound desc = could not find container \"420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344\": container with ID starting with 420c5b2dcead52a5d93173dc5c07404e9e83efc47107e7c5fa21bf5583c2f344 not found: ID does not exist"
Sep 15 11:59:34.316996 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.316958    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"]
Sep 15 11:59:34.319068 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.319048    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-710ce1/noten-model-710ce1-kserve-7bd898888c-62js4"]
Sep 15 11:59:34.758406 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:34.758374    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8f17e09-4498-4e8f-a11b-efbbf302dbf6" path="/var/lib/kubelet/pods/f8f17e09-4498-4e8f-a11b-efbbf302dbf6/volumes"
Sep 15 11:59:35.309947 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:35.309917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:35.882514 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:35.882483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:43.563417 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.563379    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"]
Sep 15 11:59:43.563899 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.563883    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3e2c0e8-f29b-4839-8941-97261d8c57ab" containerName="istio-proxy"
Sep 15 11:59:43.563958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.563901    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e2c0e8-f29b-4839-8941-97261d8c57ab" containerName="istio-proxy"
Sep 15 11:59:43.563958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.563910    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f17e09-4498-4e8f-a11b-efbbf302dbf6" containerName="main"
Sep 15 11:59:43.563958 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.563915    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f17e09-4498-4e8f-a11b-efbbf302dbf6" containerName="main"
Sep 15 11:59:43.564060 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.563994    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8f17e09-4498-4e8f-a11b-efbbf302dbf6" containerName="main"
Sep 15 11:59:43.564060 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.564004    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3e2c0e8-f29b-4839-8941-97261d8c57ab" containerName="istio-proxy"
Sep 15 11:59:43.566798 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.566782    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.569013 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.568992    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cc097cc5-openshift-default-dockercfg-g2m9l\""
Sep 15 11:59:43.578141 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.578119    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"]
Sep 15 11:59:43.627319 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-istio-token\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.627485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-data\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.627485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d8db78-1100-4b94-9633-ccc500ae5857-istio-podinfo\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.627485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-socket\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.627485 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-credential-socket\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.627725 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvz2q\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-kube-api-access-jvz2q\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.627725 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-envoy\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.627725 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-certs\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.627725 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.627672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d8db78-1100-4b94-9633-ccc500ae5857-istiod-ca-cert\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.728780 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.728740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-credential-socket\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.728973 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.728791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvz2q\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-kube-api-access-jvz2q\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.728973 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.728838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-envoy\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729098 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.728977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-certs\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729098 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d8db78-1100-4b94-9633-ccc500ae5857-istiod-ca-cert\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729098 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729094    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-istio-token\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-credential-socket\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729277 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-data\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729359 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-certs\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729359 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d8db78-1100-4b94-9633-ccc500ae5857-istio-podinfo\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729430 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-socket\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729663 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-data\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729755 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729734    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-socket\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.729816 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.729801    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d8db78-1100-4b94-9633-ccc500ae5857-istiod-ca-cert\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.731235 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.731204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-envoy\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.731498 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.731482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d8db78-1100-4b94-9633-ccc500ae5857-istio-podinfo\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.737435 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.737413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-istio-token\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.737629 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.737612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvz2q\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-kube-api-access-jvz2q\") pod \"e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") " pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:43.878017 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:43.877938    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:44.154638 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.154611    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"]
Sep 15 11:59:44.156433 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:59:44.156405    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d8db78_1100_4b94_9633_ccc500ae5857.slice/crio-afe2fab2d115036952ec1aecdc3254a9c23e6dbf00c908eb182c987c1f65fefa WatchSource:0}: Error finding container afe2fab2d115036952ec1aecdc3254a9c23e6dbf00c908eb182c987c1f65fefa: Status 404 returned error can't find the container with id afe2fab2d115036952ec1aecdc3254a9c23e6dbf00c908eb182c987c1f65fefa
Sep 15 11:59:44.158922 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.158887    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:44.159001 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.158953    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:44.159001 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.158982    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 11:59:44.347675 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.347630    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" event={"ID":"79d8db78-1100-4b94-9633-ccc500ae5857","Type":"ContainerStarted","Data":"9974182306fe9a80f30172b0d54baa88b571d09130e0fcfa3e18fe55ac1bbb98"}
Sep 15 11:59:44.347866 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.347705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" event={"ID":"79d8db78-1100-4b94-9633-ccc500ae5857","Type":"ContainerStarted","Data":"afe2fab2d115036952ec1aecdc3254a9c23e6dbf00c908eb182c987c1f65fefa"}
Sep 15 11:59:44.373645 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.373593    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podStartSLOduration=1.373573955 podStartE2EDuration="1.373573955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:59:44.372999695 +0000 UTC m=+1282.096741383" watchObservedRunningTime="2026-09-15 11:59:44.373573955 +0000 UTC m=+1282.097315641"
Sep 15 11:59:44.838438 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.838398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:44.878349 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.878328    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:44.940321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:44.940288    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:45.682847 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:45.682810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:45.883414 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:45.883386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:46.258741 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:46.258687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:46.354789 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:46.354753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:46.358115 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:46.358092    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:46.359074 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:46.359053    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 11:59:46.660137 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:46.660051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:47.458549 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:47.458515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:48.223921 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:48.223886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:49.159833 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:49.159793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:49.868831 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:49.868797    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:50.711376 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:50.711342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:51.405302 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.405270    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"]
Sep 15 11:59:51.408162 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.408132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.413252 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.413233    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cc097cc5-serving-cert\""
Sep 15 11:59:51.424712 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.424685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"]
Sep 15 11:59:51.432661 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.432636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:51.510924 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.510892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-metrics-certs\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.511081 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.510943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkf2t\" (UniqueName: \"kubernetes.io/projected/03c88523-8ca9-4377-b017-8daf63dc3f54-kube-api-access-hkf2t\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.511081 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.511039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.511177 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.511096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c88523-8ca9-4377-b017-8daf63dc3f54-openshift-service-ca\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.536340 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.536189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:51.612418 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.612385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-metrics-certs\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.612598 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.612434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkf2t\" (UniqueName: \"kubernetes.io/projected/03c88523-8ca9-4377-b017-8daf63dc3f54-kube-api-access-hkf2t\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.612598 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.612491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.612598 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.612534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c88523-8ca9-4377-b017-8daf63dc3f54-openshift-service-ca\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.612778 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:59:51.612633    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-serving-cert: secret "maas-api-e2e-mt-cc097cc5-serving-cert" not found
Sep 15 11:59:51.612778 ip-10-0-139-13 kubenswrapper[2564]: E0915 11:59:51.612718    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls podName:03c88523-8ca9-4377-b017-8daf63dc3f54 nodeName:}" failed. No retries permitted until 2026-09-15 11:59:52.11269691 +0000 UTC m=+1289.836438592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls") pod "maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5" (UID: "03c88523-8ca9-4377-b017-8daf63dc3f54") : secret "maas-api-e2e-mt-cc097cc5-serving-cert" not found
Sep 15 11:59:51.613168 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.613149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c88523-8ca9-4377-b017-8daf63dc3f54-openshift-service-ca\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.614875 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.614859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-metrics-certs\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.624510 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.624485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkf2t\" (UniqueName: \"kubernetes.io/projected/03c88523-8ca9-4377-b017-8daf63dc3f54-kube-api-access-hkf2t\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:51.732202 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.732172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:51.936533 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:51.936500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:52.030992 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:52.030909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:52.117185 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:52.117151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:52.119507 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:52.119489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls\") pod \"maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:52.319184 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:52.319101    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:52.598889 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:52.598788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:52.599415 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:52.599394    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"]
Sep 15 11:59:52.601209 ip-10-0-139-13 kubenswrapper[2564]: W0915 11:59:52.601188    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c88523_8ca9_4377_b017_8daf63dc3f54.slice/crio-307ff766bf86b4eab968ba1e8b9b95a0a69355d3e3637c6c3a5e405a1bf9c25a WatchSource:0}: Error finding container 307ff766bf86b4eab968ba1e8b9b95a0a69355d3e3637c6c3a5e405a1bf9c25a: Status 404 returned error can't find the container with id 307ff766bf86b4eab968ba1e8b9b95a0a69355d3e3637c6c3a5e405a1bf9c25a
Sep 15 11:59:53.399945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:53.399852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5" event={"ID":"03c88523-8ca9-4377-b017-8daf63dc3f54","Type":"ContainerStarted","Data":"e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b"}
Sep 15 11:59:53.399945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:53.399905    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5" event={"ID":"03c88523-8ca9-4377-b017-8daf63dc3f54","Type":"ContainerStarted","Data":"307ff766bf86b4eab968ba1e8b9b95a0a69355d3e3637c6c3a5e405a1bf9c25a"}
Sep 15 11:59:53.399945 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:53.399927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 11:59:53.425259 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:53.425195    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5" podStartSLOduration=2.061150614 podStartE2EDuration="2.425181687s" totalImagesPullingTime="364.031073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:59:53.424071244 +0000 UTC m=+1291.147812923" watchObservedRunningTime="2026-09-15 11:59:53.425181687 +0000 UTC m=+1291.148923373"
Sep 15 11:59:53.602509 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:53.602471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:55.838065 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:55.838032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:55.939645 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:55.939611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:56.039330 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:56.039298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:56.434105 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:56.434076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:56.737321 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:56.737287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:56.867019 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:56.866980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:57.722097 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:57.722069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:58.590765 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:58.590736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:59.386423 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:59.386390    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:59.409700 ip-10-0-139-13 kubenswrapper[2564]: I0915 11:59:59.409677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 12:00:00.160292 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.160259    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg"]
Sep 15 12:00:00.163960 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.163938    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"]
Sep 15 12:00:00.164121 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.164071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg"
Sep 15 12:00:00.167689 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.167666    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"
Sep 15 12:00:00.170192 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.169954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfdnn\""
Sep 15 12:00:00.176964 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.176932    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"]
Sep 15 12:00:00.178390 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.178202    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg"
Sep 15 12:00:00.180358 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.180337    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg"]
Sep 15 12:00:00.187880 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.187858    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"
Sep 15 12:00:00.189797 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.189775    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"]
Sep 15 12:00:00.194272 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.194249    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"
Sep 15 12:00:00.205062 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.205038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"]
Sep 15 12:00:00.229621 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.229597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"
Sep 15 12:00:00.482044 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.482016    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"]
Sep 15 12:00:00.484051 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:00:00.484025    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6aca13_229b_4dbf_b571_3acf6520eca3.slice/crio-13cbe60f05224332fd6cc93a532b3c1166ee3143c30139ebb222f7876e4c0328 WatchSource:0}: Error finding container 13cbe60f05224332fd6cc93a532b3c1166ee3143c30139ebb222f7876e4c0328: Status 404 returned error can't find the container with id 13cbe60f05224332fd6cc93a532b3c1166ee3143c30139ebb222f7876e4c0328
Sep 15 12:00:00.484515 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.484493    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg"]
Sep 15 12:00:00.522659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:00.522637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"]
Sep 15 12:00:00.525100 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:00:00.525074    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8e55f1_2a00_4cb3_9079_4c204eec5440.slice/crio-2d9f7fcdab56fac2eb39c9b793d76797ee8889aa8c82066662b2cc60dd393172 WatchSource:0}: Error finding container 2d9f7fcdab56fac2eb39c9b793d76797ee8889aa8c82066662b2cc60dd393172: Status 404 returned error can't find the container with id 2d9f7fcdab56fac2eb39c9b793d76797ee8889aa8c82066662b2cc60dd393172
Sep 15 12:00:01.444296 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:01.444257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg" event={"ID":"bb64edd5-38d4-44d6-996e-f0fef36061c4","Type":"ContainerStarted","Data":"3d7405311ca0215b243f72cbd57585ef86a9f874884b1e215b5afb5f85d438bc"}
Sep 15 12:00:01.445534 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:01.445507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8" event={"ID":"9b8e55f1-2a00-4cb3-9079-4c204eec5440","Type":"ContainerStarted","Data":"2d9f7fcdab56fac2eb39c9b793d76797ee8889aa8c82066662b2cc60dd393172"}
Sep 15 12:00:01.446680 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:01.446659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv" event={"ID":"bf6aca13-229b-4dbf-b571-3acf6520eca3","Type":"ContainerStarted","Data":"13cbe60f05224332fd6cc93a532b3c1166ee3143c30139ebb222f7876e4c0328"}
Sep 15 12:00:02.525909 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:02.525876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:03.467661 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:03.467613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:03.835402 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:03.835312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:04.134889 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.134789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:04.237382 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.237338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:04.481549 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.481513    2564 generic.go:356] "Generic (PLEG): container finished" podID="bb64edd5-38d4-44d6-996e-f0fef36061c4" containerID="abf5d33a3565bc7aed159ed6e740a786485f7c3c118acbbccb6d5f81cac06ca6" exitCode=0
Sep 15 12:00:04.481736 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.481602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg" event={"ID":"bb64edd5-38d4-44d6-996e-f0fef36061c4","Type":"ContainerDied","Data":"abf5d33a3565bc7aed159ed6e740a786485f7c3c118acbbccb6d5f81cac06ca6"}
Sep 15 12:00:04.483294 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.483266    2564 generic.go:356] "Generic (PLEG): container finished" podID="9b8e55f1-2a00-4cb3-9079-4c204eec5440" containerID="034711cb4753e534d86cf1a80e7745ad2265f9cc4c25801998b77ff4532b7be5" exitCode=0
Sep 15 12:00:04.483427 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.483347    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8" event={"ID":"9b8e55f1-2a00-4cb3-9079-4c204eec5440","Type":"ContainerDied","Data":"034711cb4753e534d86cf1a80e7745ad2265f9cc4c25801998b77ff4532b7be5"}
Sep 15 12:00:04.484914 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.484891    2564 generic.go:356] "Generic (PLEG): container finished" podID="bf6aca13-229b-4dbf-b571-3acf6520eca3" containerID="0c95fa53d7f77a5881caf00af4b40099190401edea3c52fcac890cc6d2ddbe11" exitCode=0
Sep 15 12:00:04.485035 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.484967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv" event={"ID":"bf6aca13-229b-4dbf-b571-3acf6520eca3","Type":"ContainerDied","Data":"0c95fa53d7f77a5881caf00af4b40099190401edea3c52fcac890cc6d2ddbe11"}
Sep 15 12:00:04.856642 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:04.856552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:05.647113 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:05.647085    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"
Sep 15 12:00:05.689667 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:05.689641    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"
Sep 15 12:00:05.700455 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:05.700428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:05.722481 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:05.722452    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg"
Sep 15 12:00:06.498529 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.498502    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg"
Sep 15 12:00:06.498529 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.498517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824560-j79zg" event={"ID":"bb64edd5-38d4-44d6-996e-f0fef36061c4","Type":"ContainerDied","Data":"3d7405311ca0215b243f72cbd57585ef86a9f874884b1e215b5afb5f85d438bc"}
Sep 15 12:00:06.499075 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.498565    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d7405311ca0215b243f72cbd57585ef86a9f874884b1e215b5afb5f85d438bc"
Sep 15 12:00:06.500154 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.500138    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"
Sep 15 12:00:06.500303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.500161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8" event={"ID":"9b8e55f1-2a00-4cb3-9079-4c204eec5440","Type":"ContainerDied","Data":"2d9f7fcdab56fac2eb39c9b793d76797ee8889aa8c82066662b2cc60dd393172"}
Sep 15 12:00:06.500303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.500211    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d9f7fcdab56fac2eb39c9b793d76797ee8889aa8c82066662b2cc60dd393172"
Sep 15 12:00:06.501711 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.501689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv" event={"ID":"bf6aca13-229b-4dbf-b571-3acf6520eca3","Type":"ContainerDied","Data":"13cbe60f05224332fd6cc93a532b3c1166ee3143c30139ebb222f7876e4c0328"}
Sep 15 12:00:06.501711 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.501699    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"
Sep 15 12:00:06.501868 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.501729    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13cbe60f05224332fd6cc93a532b3c1166ee3143c30139ebb222f7876e4c0328"
Sep 15 12:00:06.536523 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.536495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:06.963351 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:06.963315    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:00:07.527949 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:07.527914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:08.397163 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:08.397133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:08.836286 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:08.836248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:09.184362 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:09.184277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:09.899604 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:09.899564    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:11.065245 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:11.065189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:11.196174 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:11.196139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:11.441057 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:11.441024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:12.311483 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:12.311445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:13.193673 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:13.193637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:17.399404 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:17.399362    2564 patch_prober.go:28] interesting pod/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 12:00:17.399824 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:17.399443    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 12:00:18.575558 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:18.575520    2564 generic.go:356] "Generic (PLEG): container finished" podID="79d8db78-1100-4b94-9633-ccc500ae5857" containerID="9974182306fe9a80f30172b0d54baa88b571d09130e0fcfa3e18fe55ac1bbb98" exitCode=0
Sep 15 12:00:18.576045 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:18.575592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" event={"ID":"79d8db78-1100-4b94-9633-ccc500ae5857","Type":"ContainerDied","Data":"9974182306fe9a80f30172b0d54baa88b571d09130e0fcfa3e18fe55ac1bbb98"}
Sep 15 12:00:18.576045 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:18.576023    2564 scope.go:117] "RemoveContainer" containerID="9974182306fe9a80f30172b0d54baa88b571d09130e0fcfa3e18fe55ac1bbb98"
Sep 15 12:00:18.577400 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:18.577372    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:00:18.577468 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:18.577458    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:00:18.577507 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:18.577490    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:00:19.444791 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:19.444757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:19.585491 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:19.585458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" event={"ID":"79d8db78-1100-4b94-9633-ccc500ae5857","Type":"ContainerStarted","Data":"9234e99c34c33552752b101daf67cef67f7978f234a841104e72f55c94a45ea9"}
Sep 15 12:00:19.878786 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:19.878704    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 12:00:19.878933 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:19.878870    2564 patch_prober.go:28] interesting pod/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 12:00:19.878933 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:19.878914    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 12:00:20.879202 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:20.879169    2564 patch_prober.go:28] interesting pod/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 12:00:20.879600 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:20.879249    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 12:00:20.912596 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:20.912563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:21.012866 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:21.012833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:21.879011 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:21.878977    2564 patch_prober.go:28] interesting pod/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 12:00:21.879195 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:21.879036    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 12:00:22.878840 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:22.878804    2564 patch_prober.go:28] interesting pod/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 12:00:22.879254 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:22.878873    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 12:00:23.878841 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:23.878802    2564 patch_prober.go:28] interesting pod/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 12:00:23.879258 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:23.878885    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 12:00:24.274270 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:24.274151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:24.878814 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:24.878761    2564 patch_prober.go:28] interesting pod/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 15 12:00:24.879022 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:24.878850    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 15 12:00:25.890791 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:25.890757    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 12:00:25.892595 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:25.892505    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 12:00:25.897745 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:25.897686    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 12:00:26.669723 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:26.669692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:29.554157 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:29.554125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:29.655060 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:29.655023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:32.299135 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:32.299102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:32.666163 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:32.666090    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:00:41.092150 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:41.092115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:46.309750 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:46.309665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:46.522252 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:46.522189    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"]
Sep 15 12:00:46.522466 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:46.522443    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy" containerID="cri-o://39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498" gracePeriod=30
Sep 15 12:00:46.548858 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:46.548821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:47.027997 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:47.027959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:47.807019 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:47.806985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:48.515315 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:48.515278    2564 patch_prober.go:28] interesting pod/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:00:48.515472 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:48.515344    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:00:49.751346 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:49.751313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:49.858089 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:49.858030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:50.497049 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:50.497017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:51.410913 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.410873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:51.787209 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.787185    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 12:00:51.787586 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.787567    2564 generic.go:356] "Generic (PLEG): container finished" podID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerID="39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498" exitCode=0
Sep 15 12:00:51.787765 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.787637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" event={"ID":"d71e7a3c-b537-4d18-83d9-19e1109ffc4e","Type":"ContainerDied","Data":"39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498"}
Sep 15 12:00:51.787765 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.787692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq" event={"ID":"d71e7a3c-b537-4d18-83d9-19e1109ffc4e","Type":"ContainerDied","Data":"c31fd661e0d6d1dccfc9a8fb1e31da494ccfb217dc80468a2f3e89ecdf2a4ef2"}
Sep 15 12:00:51.787765 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.787715    2564 scope.go:117] "RemoveContainer" containerID="39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498"
Sep 15 12:00:51.796500 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.796481    2564 scope.go:117] "RemoveContainer" containerID="8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1"
Sep 15 12:00:51.804601 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.804582    2564 scope.go:117] "RemoveContainer" containerID="39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498"
Sep 15 12:00:51.804880 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:00:51.804862    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498\": container with ID starting with 39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498 not found: ID does not exist" containerID="39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498"
Sep 15 12:00:51.804947 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.804886    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498"} err="failed to get container status \"39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498\": rpc error: code = NotFound desc = could not find container \"39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498\": container with ID starting with 39ccc3f352c8c11170dfb56964d5a9a637014e22309529d15dde9ca74d15d498 not found: ID does not exist"
Sep 15 12:00:51.804947 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.804902    2564 scope.go:117] "RemoveContainer" containerID="8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1"
Sep 15 12:00:51.805174 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:00:51.805152    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1\": container with ID starting with 8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1 not found: ID does not exist" containerID="8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1"
Sep 15 12:00:51.805245 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.805183    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1"} err="failed to get container status \"8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1\": rpc error: code = NotFound desc = could not find container \"8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1\": container with ID starting with 8fe058619eeee1c392344bb683648823c64bfa6d490fa90a883b93a7eaff48e1 not found: ID does not exist"
Sep 15 12:00:51.893457 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893425    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-envoy\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.893634 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-token\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.893634 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893517    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-data\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.893634 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893552    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2snc\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-kube-api-access-r2snc\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.893634 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893605    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-credential-socket\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.893853 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893643    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istiod-ca-cert\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.893853 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893735    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-certs\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.893853 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893762    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-socket\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.894000 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893876    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-podinfo\") pod \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\" (UID: \"d71e7a3c-b537-4d18-83d9-19e1109ffc4e\") "
Sep 15 12:00:51.894000 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:51.894000 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.893898    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:51.894136 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.894036    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:51.894136 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.894124    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:51.894254 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.894153    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:51.894367 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.894346    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:51.894430 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.894375    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:51.894430 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.894391    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:51.894430 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.894403    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:51.894430 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.894415    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:51.895942 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.895920    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:51.896144 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.896126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:00:51.896249 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.896155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-kube-api-access-r2snc" (OuterVolumeSpecName: "kube-api-access-r2snc") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "kube-api-access-r2snc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:51.896249 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.896160    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d71e7a3c-b537-4d18-83d9-19e1109ffc4e" (UID: "d71e7a3c-b537-4d18-83d9-19e1109ffc4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:00:51.996034 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.995952    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:51.996034 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.995984    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:51.996034 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.995992    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:51.996034 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:51.996000    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2snc\" (UniqueName: \"kubernetes.io/projected/d71e7a3c-b537-4d18-83d9-19e1109ffc4e-kube-api-access-r2snc\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:52.190832 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:52.190800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:52.793962 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:52.793937    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"
Sep 15 12:00:52.813660 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:52.813628    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"]
Sep 15 12:00:52.820012 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:52.819987    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq"]
Sep 15 12:00:52.897332 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:52.897291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:54.757382 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:54.757349    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" path="/var/lib/kubelet/pods/d71e7a3c-b537-4d18-83d9-19e1109ffc4e/volumes"
Sep 15 12:00:57.568514 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.568480    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"]
Sep 15 12:00:57.568932 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.568739    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww" podUID="c98cf93c-837c-4be7-8e21-b4a8e9097053" containerName="maas-api" containerID="cri-o://538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985" gracePeriod=30
Sep 15 12:00:57.593090 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.593057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:57.604296 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.604263    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"]
Sep 15 12:00:57.607799 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.607777    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e9bc87-29824560-gpqr8"]
Sep 15 12:00:57.814193 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.814167    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 12:00:57.824089 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.824022    2564 generic.go:356] "Generic (PLEG): container finished" podID="c98cf93c-837c-4be7-8e21-b4a8e9097053" containerID="538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985" exitCode=0
Sep 15 12:00:57.824089 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.824063    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"
Sep 15 12:00:57.824331 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.824104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww" event={"ID":"c98cf93c-837c-4be7-8e21-b4a8e9097053","Type":"ContainerDied","Data":"538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985"}
Sep 15 12:00:57.824331 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.824164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww" event={"ID":"c98cf93c-837c-4be7-8e21-b4a8e9097053","Type":"ContainerDied","Data":"a2b059e1dfb6b4bfb56dac6afe68e6f01e937c2ef9a0cd9b6483816c94990f76"}
Sep 15 12:00:57.824331 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.824195    2564 scope.go:117] "RemoveContainer" containerID="538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985"
Sep 15 12:00:57.834040 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.834011    2564 scope.go:117] "RemoveContainer" containerID="538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985"
Sep 15 12:00:57.834562 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:00:57.834458    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985\": container with ID starting with 538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985 not found: ID does not exist" containerID="538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985"
Sep 15 12:00:57.834562 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.834515    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985"} err="failed to get container status \"538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985\": rpc error: code = NotFound desc = could not find container \"538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985\": container with ID starting with 538aeb154cb1cc16752c2754480b326c19c6f2bed62c1aff6ecaec223325b985 not found: ID does not exist"
Sep 15 12:00:57.958822 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.958790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c98cf93c-837c-4be7-8e21-b4a8e9097053-openshift-service-ca\") pod \"c98cf93c-837c-4be7-8e21-b4a8e9097053\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") "
Sep 15 12:00:57.959758 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.959735    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-metrics-certs\") pod \"c98cf93c-837c-4be7-8e21-b4a8e9097053\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") "
Sep 15 12:00:57.960321 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.960302    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqf5x\" (UniqueName: \"kubernetes.io/projected/c98cf93c-837c-4be7-8e21-b4a8e9097053-kube-api-access-bqf5x\") pod \"c98cf93c-837c-4be7-8e21-b4a8e9097053\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") "
Sep 15 12:00:57.960759 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.960743    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls\") pod \"c98cf93c-837c-4be7-8e21-b4a8e9097053\" (UID: \"c98cf93c-837c-4be7-8e21-b4a8e9097053\") "
Sep 15 12:00:57.961296 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.959423    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c98cf93c-837c-4be7-8e21-b4a8e9097053-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c98cf93c-837c-4be7-8e21-b4a8e9097053" (UID: "c98cf93c-837c-4be7-8e21-b4a8e9097053"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:57.961296 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.961272    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c98cf93c-837c-4be7-8e21-b4a8e9097053-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:57.965780 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.965745    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c98cf93c-837c-4be7-8e21-b4a8e9097053" (UID: "c98cf93c-837c-4be7-8e21-b4a8e9097053"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:57.985696 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.985510    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c98cf93c-837c-4be7-8e21-b4a8e9097053" (UID: "c98cf93c-837c-4be7-8e21-b4a8e9097053"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:57.989722 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:57.989638    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98cf93c-837c-4be7-8e21-b4a8e9097053-kube-api-access-bqf5x" (OuterVolumeSpecName: "kube-api-access-bqf5x") pod "c98cf93c-837c-4be7-8e21-b4a8e9097053" (UID: "c98cf93c-837c-4be7-8e21-b4a8e9097053"). InnerVolumeSpecName "kube-api-access-bqf5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:58.062711 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:58.062682    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:58.062711 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:58.062710    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqf5x\" (UniqueName: \"kubernetes.io/projected/c98cf93c-837c-4be7-8e21-b4a8e9097053-kube-api-access-bqf5x\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:58.062711 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:58.062722    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c98cf93c-837c-4be7-8e21-b4a8e9097053-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:00:58.147810 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:58.147775    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"]
Sep 15 12:00:58.154003 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:58.153977    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9bc87-89d7bd7-d7jww"]
Sep 15 12:00:58.756469 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:58.756440    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8e55f1-2a00-4cb3-9079-4c204eec5440" path="/var/lib/kubelet/pods/9b8e55f1-2a00-4cb3-9079-4c204eec5440/volumes"
Sep 15 12:00:58.756828 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:00:58.756808    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98cf93c-837c-4be7-8e21-b4a8e9097053" path="/var/lib/kubelet/pods/c98cf93c-837c-4be7-8e21-b4a8e9097053/volumes"
Sep 15 12:01:00.826352 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:00.826322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:00.924395 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:00.924361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:01.558862 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:01.558830    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:02.284179 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:02.284135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:04.686141 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:04.686104    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:04.785758 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:04.785729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:04.926613 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:04.926583    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"]
Sep 15 12:01:04.926826 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:04.926805    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy" containerID="cri-o://345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401" gracePeriod=30
Sep 15 12:01:04.955600 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:04.955573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:05.469778 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.469742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:05.738002 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.737929    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"]
Sep 15 12:01:05.738425 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738411    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8e55f1-2a00-4cb3-9079-4c204eec5440" containerName="cleanup"
Sep 15 12:01:05.738481 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738427    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8e55f1-2a00-4cb3-9079-4c204eec5440" containerName="cleanup"
Sep 15 12:01:05.738481 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738448    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf6aca13-229b-4dbf-b571-3acf6520eca3" containerName="cleanup"
Sep 15 12:01:05.738481 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738455    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf6aca13-229b-4dbf-b571-3acf6520eca3" containerName="cleanup"
Sep 15 12:01:05.738481 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738476    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb64edd5-38d4-44d6-996e-f0fef36061c4" containerName="cleanup"
Sep 15 12:01:05.738481 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738482    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb64edd5-38d4-44d6-996e-f0fef36061c4" containerName="cleanup"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738490    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738495    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738505    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98cf93c-837c-4be7-8e21-b4a8e9097053" containerName="maas-api"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738509    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98cf93c-837c-4be7-8e21-b4a8e9097053" containerName="maas-api"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738519    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738524    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738587    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8e55f1-2a00-4cb3-9079-4c204eec5440" containerName="cleanup"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738595    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738602    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf6aca13-229b-4dbf-b571-3acf6520eca3" containerName="cleanup"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738614    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb64edd5-38d4-44d6-996e-f0fef36061c4" containerName="cleanup"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738624    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d71e7a3c-b537-4d18-83d9-19e1109ffc4e" containerName="istio-proxy"
Sep 15 12:01:05.738659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.738630    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98cf93c-837c-4be7-8e21-b4a8e9097053" containerName="maas-api"
Sep 15 12:01:05.743294 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.743275    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.745771 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.745753    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-2b3936-openshift-default-dockercfg-dp8vh\""
Sep 15 12:01:05.753350 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.753325    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"]
Sep 15 12:01:05.760762 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.760733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:05.845047 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9nxs\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-kube-api-access-g9nxs\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.845345 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-credential-socket\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.845494 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-token\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.845494 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-socket\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.845494 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-certs\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.845680 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-podinfo\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.845680 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97d07825-8754-4dba-b60f-00b20a45ac8e-istiod-ca-cert\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.845680 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-envoy\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.845840 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.845706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-data\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.946747 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.946708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-envoy\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.946929 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.946757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-data\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.946929 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.946886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9nxs\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-kube-api-access-g9nxs\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947016 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.946924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-credential-socket\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947016 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-token\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947116 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-socket\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947154 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-certs\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947203 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-data\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947302 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-podinfo\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947361 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-credential-socket\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947402 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97d07825-8754-4dba-b60f-00b20a45ac8e-istiod-ca-cert\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947507 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-socket\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947594 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-certs\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.947873 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.947855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97d07825-8754-4dba-b60f-00b20a45ac8e-istiod-ca-cert\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.949412 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.949391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-envoy\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.949817 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.949797    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-podinfo\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.955831 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.955804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-token\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:05.955977 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:05.955961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9nxs\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-kube-api-access-g9nxs\") pod \"e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") " pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:06.055275 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.055176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:06.136494 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.136453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:06.336857 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.336830    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"]
Sep 15 12:01:06.338367 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:01:06.338341    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d07825_8754_4dba_b60f_00b20a45ac8e.slice/crio-4e2a4f5beb6e2d78f88cd92960228e2c67347eef5c1fd636a576e93ff04728a6 WatchSource:0}: Error finding container 4e2a4f5beb6e2d78f88cd92960228e2c67347eef5c1fd636a576e93ff04728a6: Status 404 returned error can't find the container with id 4e2a4f5beb6e2d78f88cd92960228e2c67347eef5c1fd636a576e93ff04728a6
Sep 15 12:01:06.341113 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.341082    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:06.341195 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.341142    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:06.341195 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.341170    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:06.880623 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.880588    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" event={"ID":"97d07825-8754-4dba-b60f-00b20a45ac8e","Type":"ContainerStarted","Data":"2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773"}
Sep 15 12:01:06.881005 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.880636    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" event={"ID":"97d07825-8754-4dba-b60f-00b20a45ac8e","Type":"ContainerStarted","Data":"4e2a4f5beb6e2d78f88cd92960228e2c67347eef5c1fd636a576e93ff04728a6"}
Sep 15 12:01:06.909436 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:06.909387    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" podStartSLOduration=1.909371041 podStartE2EDuration="1.909371041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:06.906925965 +0000 UTC m=+1364.630667655" watchObservedRunningTime="2026-09-15 12:01:06.909371041 +0000 UTC m=+1364.633112802"
Sep 15 12:01:07.056129 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:07.056099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:07.061595 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:07.061570    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:07.886605 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:07.886573    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:07.887645 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:07.887623    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:08.015374 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:08.015338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:08.802052 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:08.802015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:08.901777 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:08.901739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:08.960303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:08.960264    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:01:09.066497 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:09.066416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:09.166629 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:09.166597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:09.992929 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:09.992893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:10.194270 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.194197    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 12:01:10.294464 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294436    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-token\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294638 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294472    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-envoy\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294638 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294495    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-podinfo\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294638 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294528    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-certs\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294638 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294565    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-credential-socket\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294638 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294622    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-socket\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294906 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294646    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-data\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294906 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294739    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a09514-b3a1-4dc8-b788-fab03de797c3-istiod-ca-cert\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294906 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294797    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5zm7\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-kube-api-access-d5zm7\") pod \"b4a09514-b3a1-4dc8-b788-fab03de797c3\" (UID: \"b4a09514-b3a1-4dc8-b788-fab03de797c3\") "
Sep 15 12:01:10.294906 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:10.295100 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294902    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:10.295100 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.294916    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:10.295100 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.295062    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:10.295307 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.295197    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4a09514-b3a1-4dc8-b788-fab03de797c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:10.295375 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.295357    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.295421 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.295381    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.295421 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.295396    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.295421 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.295410    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a09514-b3a1-4dc8-b788-fab03de797c3-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.295538 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.295423    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.296844 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.296813    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:01:10.297059 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.297034    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:01:10.297059 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.297054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:10.297256 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.297155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-kube-api-access-d5zm7" (OuterVolumeSpecName: "kube-api-access-d5zm7") pod "b4a09514-b3a1-4dc8-b788-fab03de797c3" (UID: "b4a09514-b3a1-4dc8-b788-fab03de797c3"). InnerVolumeSpecName "kube-api-access-d5zm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:10.396178 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.396135    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5zm7\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-kube-api-access-d5zm7\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.396178 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.396175    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.396178 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.396187    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.396435 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.396195    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a09514-b3a1-4dc8-b788-fab03de797c3-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:01:10.737090 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.737057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:10.904271 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.904239    2564 generic.go:356] "Generic (PLEG): container finished" podID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerID="345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401" exitCode=0
Sep 15 12:01:10.904445 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.904289    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"
Sep 15 12:01:10.904445 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.904334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" event={"ID":"b4a09514-b3a1-4dc8-b788-fab03de797c3","Type":"ContainerDied","Data":"345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401"}
Sep 15 12:01:10.904445 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.904391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth" event={"ID":"b4a09514-b3a1-4dc8-b788-fab03de797c3","Type":"ContainerDied","Data":"0c1dc33359eb6faa5e743db26cdd3712260d04e69dddb89fffb1eff654c74089"}
Sep 15 12:01:10.904445 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.904415    2564 scope.go:117] "RemoveContainer" containerID="345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401"
Sep 15 12:01:10.913521 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.913504    2564 scope.go:117] "RemoveContainer" containerID="8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d"
Sep 15 12:01:10.923969 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.923863    2564 scope.go:117] "RemoveContainer" containerID="345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401"
Sep 15 12:01:10.923969 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:01:10.924294    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401\": container with ID starting with 345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401 not found: ID does not exist" containerID="345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401"
Sep 15 12:01:10.923969 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.924328    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401"} err="failed to get container status \"345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401\": rpc error: code = NotFound desc = could not find container \"345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401\": container with ID starting with 345284a3f880b99f75f89d56ad9d2b1915dcf61924290a6f6745c3e2d9349401 not found: ID does not exist"
Sep 15 12:01:10.923969 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.924352    2564 scope.go:117] "RemoveContainer" containerID="8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d"
Sep 15 12:01:10.924736 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:01:10.924633    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d\": container with ID starting with 8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d not found: ID does not exist" containerID="8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d"
Sep 15 12:01:10.924736 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.924663    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d"} err="failed to get container status \"8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d\": rpc error: code = NotFound desc = could not find container \"8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d\": container with ID starting with 8f664563d6f9f550201ce29859341087c0de7193e2efd7c4883341823ad0099d not found: ID does not exist"
Sep 15 12:01:10.927323 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.927295    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"]
Sep 15 12:01:10.929384 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:10.929367    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth"]
Sep 15 12:01:11.496168 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:11.496137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:12.350991 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:12.350959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:12.763783 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:12.763751    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" path="/var/lib/kubelet/pods/b4a09514-b3a1-4dc8-b788-fab03de797c3/volumes"
Sep 15 12:01:13.068872 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.068761    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"]
Sep 15 12:01:13.069448 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.069429    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy"
Sep 15 12:01:13.069448 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.069448    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy"
Sep 15 12:01:13.069616 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.069529    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy"
Sep 15 12:01:13.069616 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.069537    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy"
Sep 15 12:01:13.073783 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.073766    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.076158 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.076134    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-2b3936-serving-cert\""
Sep 15 12:01:13.082816 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.082794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"]
Sep 15 12:01:13.119195 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.119166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:13.123778 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.123752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2mf\" (UniqueName: \"kubernetes.io/projected/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-kube-api-access-lm2mf\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.123908 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.123797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.123908 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.123820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.123990 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.123920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.218069 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.218039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:13.225443 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.225416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2mf\" (UniqueName: \"kubernetes.io/projected/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-kube-api-access-lm2mf\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.225580 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.225484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.225580 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.225511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.225708 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.225612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.226207 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.226186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.228006 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.227988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.228124 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.228108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.234827 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.234806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2mf\" (UniqueName: \"kubernetes.io/projected/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-kube-api-access-lm2mf\") pod \"maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.320368 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.320297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:13.386038 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.386012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:13.616274 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.616179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:13.667867 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.667841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"]
Sep 15 12:01:13.669422 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:01:13.669387    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb823c0_bd24_47f6_adaa_f9d7f6a1c940.slice/crio-00ae501ab63166a71e595af588a79e902483a0d309922c24dc3df6cb39604268 WatchSource:0}: Error finding container 00ae501ab63166a71e595af588a79e902483a0d309922c24dc3df6cb39604268: Status 404 returned error can't find the container with id 00ae501ab63166a71e595af588a79e902483a0d309922c24dc3df6cb39604268
Sep 15 12:01:13.709098 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.709073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:13.923023 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:13.922943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw" event={"ID":"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940","Type":"ContainerStarted","Data":"00ae501ab63166a71e595af588a79e902483a0d309922c24dc3df6cb39604268"}
Sep 15 12:01:15.934847 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:15.934814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw" event={"ID":"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940","Type":"ContainerStarted","Data":"399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85"}
Sep 15 12:01:15.935278 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:15.934891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:15.962274 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:15.962228    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw" podStartSLOduration=1.202147118 podStartE2EDuration="2.962203741s" totalImagesPullingTime="1.760056623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:15.959296748 +0000 UTC m=+1373.683038434" watchObservedRunningTime="2026-09-15 12:01:15.962203741 +0000 UTC m=+1373.685945426"
Sep 15 12:01:21.949033 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:21.949004    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:01:33.043767 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:33.043733    2564 generic.go:356] "Generic (PLEG): container finished" podID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerID="2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773" exitCode=0
Sep 15 12:01:33.044192 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:33.043805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" event={"ID":"97d07825-8754-4dba-b60f-00b20a45ac8e","Type":"ContainerDied","Data":"2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773"}
Sep 15 12:01:33.044313 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:33.044298    2564 scope.go:117] "RemoveContainer" containerID="2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773"
Sep 15 12:01:33.045501 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:33.045475    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:33.045564 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:33.045542    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:33.045601 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:33.045574    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:34.056140 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:34.056101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" event={"ID":"97d07825-8754-4dba-b60f-00b20a45ac8e","Type":"ContainerStarted","Data":"10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa"}
Sep 15 12:01:35.064599 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:35.064562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:35.065956 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:35.065923    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 12:01:35.066105 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:35.065982    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 12:01:36.001952 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:36.001913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:36.056374 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:36.056341    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 12:01:36.056633 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:36.056605    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 12:01:36.102072 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:36.102023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:36.853967 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:36.853926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:37.055862 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:37.055814    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 12:01:37.056070 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:37.055886    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 12:01:37.743866 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:37.743826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:37.887187 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:37.887160    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:38.056147 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:38.056040    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 12:01:38.056147 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:38.056111    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 12:01:38.820240 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:38.820180    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:38.914079 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:38.914037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:39.056152 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.056111    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 15 12:01:39.056386 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.056185    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 15 12:01:39.194544 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.194509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:39.511127 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.511050    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"]
Sep 15 12:01:39.511539 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.511524    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy"
Sep 15 12:01:39.511589 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.511541    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a09514-b3a1-4dc8-b788-fab03de797c3" containerName="istio-proxy"
Sep 15 12:01:39.514141 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.514123    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.517269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.517239    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-32bbbb-openshift-default-dockercfg-7rwks\""
Sep 15 12:01:39.530314 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.530293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"]
Sep 15 12:01:39.541064 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.541035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.614845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-credential-socket\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.615005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87077052-39a9-4488-9b69-4c3cd36c4240-istiod-ca-cert\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.615064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87077052-39a9-4488-9b69-4c3cd36c4240-istio-podinfo\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.615199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-certs\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.615246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2pjw\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-kube-api-access-j2pjw\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.615300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-istio-token\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.615351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-socket\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.615408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-envoy\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.618244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.615431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-data\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716405 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-certs\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716405 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2pjw\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-kube-api-access-j2pjw\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716405 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-istio-token\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716851 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-socket\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716851 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-envoy\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716851 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-data\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716851 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-credential-socket\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716851 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87077052-39a9-4488-9b69-4c3cd36c4240-istiod-ca-cert\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716851 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716789    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-certs\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716851 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87077052-39a9-4488-9b69-4c3cd36c4240-istio-podinfo\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.716851 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.716860    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-socket\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.717542 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.717515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-credential-socket\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.717685 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.717601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-data\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.717781 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.717755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87077052-39a9-4488-9b69-4c3cd36c4240-istiod-ca-cert\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.719500 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.719473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-envoy\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.719615 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.719499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87077052-39a9-4488-9b69-4c3cd36c4240-istio-podinfo\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.732675 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.732648    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2pjw\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-kube-api-access-j2pjw\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.732675 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.732663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-istio-token\") pod \"e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") " pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:39.824622 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:39.824519    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:40.060651 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:40.060625    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:40.061626 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:40.061604    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:01:40.116253 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:40.116054    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"]
Sep 15 12:01:40.119071 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:01:40.119047    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87077052_39a9_4488_9b69_4c3cd36c4240.slice/crio-dd7bf770e687bd2a00373093fd438987320ed182b782983d69c75dceef5b31b4 WatchSource:0}: Error finding container dd7bf770e687bd2a00373093fd438987320ed182b782983d69c75dceef5b31b4: Status 404 returned error can't find the container with id dd7bf770e687bd2a00373093fd438987320ed182b782983d69c75dceef5b31b4
Sep 15 12:01:40.122124 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:40.122079    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:40.122276 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:40.122173    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:40.122346 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:40.122297    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:01:40.282942 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:40.282902    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:01:41.102883 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:41.102851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" event={"ID":"87077052-39a9-4488-9b69-4c3cd36c4240","Type":"ContainerStarted","Data":"0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc"}
Sep 15 12:01:41.103278 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:41.102907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" event={"ID":"87077052-39a9-4488-9b69-4c3cd36c4240","Type":"ContainerStarted","Data":"dd7bf770e687bd2a00373093fd438987320ed182b782983d69c75dceef5b31b4"}
Sep 15 12:01:41.136389 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:41.136338    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" podStartSLOduration=2.136322311 podStartE2EDuration="2.136322311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:41.135021136 +0000 UTC m=+1398.858762825" watchObservedRunningTime="2026-09-15 12:01:41.136322311 +0000 UTC m=+1398.860063996"
Sep 15 12:01:41.825356 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:41.825324    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:41.830487 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:41.830464    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:42.109073 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:42.108990    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:42.109889 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:42.109868    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:01:42.932323 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:42.932285    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:43.037364 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:43.037326    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:43.138446 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:43.138411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:43.357568 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:43.357538    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:44.131618 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:44.131585    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:45.200300 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:45.200270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:46.146964 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:46.146933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:47.051888 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:47.051856    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:48.301822 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:48.301789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:49.179318 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.179288    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"]
Sep 15 12:01:49.182860 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.182837    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.185378 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.185358    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-32bbbb-serving-cert\""
Sep 15 12:01:49.199932 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.199905    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"]
Sep 15 12:01:49.223923 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.223893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:49.318539 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.318504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.319154 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.319129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htjpw\" (UniqueName: \"kubernetes.io/projected/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-kube-api-access-htjpw\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.319364 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.319345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.319584 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.319567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.323239 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.321116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:49.421289 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.421255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.421461 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.421337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.421461 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.421376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjpw\" (UniqueName: \"kubernetes.io/projected/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-kube-api-access-htjpw\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.421461 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.421419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.421594 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:01:49.421527    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-serving-cert: secret "maas-api-e2e-shared-b-w3-32bbbb-serving-cert" not found
Sep 15 12:01:49.421594 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:01:49.421580    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls podName:55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad nodeName:}" failed. No retries permitted until 2026-09-15 12:01:49.921563582 +0000 UTC m=+1407.645305248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls") pod "maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb" (UID: "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad") : secret "maas-api-e2e-shared-b-w3-32bbbb-serving-cert" not found
Sep 15 12:01:49.421946 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.421919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.423792 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.423776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.430127 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.430082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htjpw\" (UniqueName: \"kubernetes.io/projected/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-kube-api-access-htjpw\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.764466 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.764432    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:49.865200 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.865144    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:49.925910 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.925870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.928335 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.928312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:49.968487 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:49.968444    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:50.094053 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:50.093961    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:50.329415 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:50.329384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:50.379124 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:50.379084    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"]
Sep 15 12:01:51.162935 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:51.162897    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb" event={"ID":"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad","Type":"ContainerStarted","Data":"4c627c75009f1bd132f1c4c6b1ebe7823b9055309ec1db968b87d8a115e6e5bb"}
Sep 15 12:01:51.626813 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:51.626778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:52.170070 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:52.170031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb" event={"ID":"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad","Type":"ContainerStarted","Data":"88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62"}
Sep 15 12:01:52.170301 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:52.170093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:01:52.196159 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:52.196106    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb" podStartSLOduration=2.286240009 podStartE2EDuration="3.196092526s" totalImagesPullingTime="909.852517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:52.193699284 +0000 UTC m=+1409.917440969" watchObservedRunningTime="2026-09-15 12:01:52.196092526 +0000 UTC m=+1409.919834211"
Sep 15 12:01:52.510412 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:52.510380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:53.415009 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:53.414977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:54.370540 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:54.370503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:55.659333 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:55.659300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:55.762845 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:55.762813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:56.522434 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:56.522400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:57.756760 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:57.756727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:58.181791 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:01:58.181718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:02:03.475390 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.475358    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"]
Sep 15 12:02:03.475783 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.475550    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5" podUID="03c88523-8ca9-4377-b017-8daf63dc3f54" containerName="maas-api" containerID="cri-o://e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b" gracePeriod=30
Sep 15 12:02:03.488898 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.488868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:03.497287 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.497261    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"]
Sep 15 12:02:03.505330 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.505298    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cc097cc5-29824560-b5fwv"]
Sep 15 12:02:03.571999 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.571964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:03.655330 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.655298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:03.729966 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.729903    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 12:02:03.733319 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.733290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:03.778633 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.778602    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c88523-8ca9-4377-b017-8daf63dc3f54-openshift-service-ca\") pod \"03c88523-8ca9-4377-b017-8daf63dc3f54\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") "
Sep 15 12:02:03.778836 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.778648    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkf2t\" (UniqueName: \"kubernetes.io/projected/03c88523-8ca9-4377-b017-8daf63dc3f54-kube-api-access-hkf2t\") pod \"03c88523-8ca9-4377-b017-8daf63dc3f54\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") "
Sep 15 12:02:03.778836 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.778710    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls\") pod \"03c88523-8ca9-4377-b017-8daf63dc3f54\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") "
Sep 15 12:02:03.778836 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.778749    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-metrics-certs\") pod \"03c88523-8ca9-4377-b017-8daf63dc3f54\" (UID: \"03c88523-8ca9-4377-b017-8daf63dc3f54\") "
Sep 15 12:02:03.779323 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.779017    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03c88523-8ca9-4377-b017-8daf63dc3f54-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03c88523-8ca9-4377-b017-8daf63dc3f54" (UID: "03c88523-8ca9-4377-b017-8daf63dc3f54"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:02:03.779323 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.779235    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c88523-8ca9-4377-b017-8daf63dc3f54-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:02:03.781462 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.781440    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03c88523-8ca9-4377-b017-8daf63dc3f54" (UID: "03c88523-8ca9-4377-b017-8daf63dc3f54"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:02:03.781462 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.781455    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c88523-8ca9-4377-b017-8daf63dc3f54-kube-api-access-hkf2t" (OuterVolumeSpecName: "kube-api-access-hkf2t") pod "03c88523-8ca9-4377-b017-8daf63dc3f54" (UID: "03c88523-8ca9-4377-b017-8daf63dc3f54"). InnerVolumeSpecName "kube-api-access-hkf2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:02:03.781625 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.781465    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "03c88523-8ca9-4377-b017-8daf63dc3f54" (UID: "03c88523-8ca9-4377-b017-8daf63dc3f54"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:02:03.887004 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.886906    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkf2t\" (UniqueName: \"kubernetes.io/projected/03c88523-8ca9-4377-b017-8daf63dc3f54-kube-api-access-hkf2t\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:02:03.887004 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.886944    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:02:03.887004 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:03.886956    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c88523-8ca9-4377-b017-8daf63dc3f54-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:02:04.242152 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.242111    2564 generic.go:356] "Generic (PLEG): container finished" podID="03c88523-8ca9-4377-b017-8daf63dc3f54" containerID="e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b" exitCode=0
Sep 15 12:02:04.242382 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.242160    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5" event={"ID":"03c88523-8ca9-4377-b017-8daf63dc3f54","Type":"ContainerDied","Data":"e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b"}
Sep 15 12:02:04.242382 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.242264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5" event={"ID":"03c88523-8ca9-4377-b017-8daf63dc3f54","Type":"ContainerDied","Data":"307ff766bf86b4eab968ba1e8b9b95a0a69355d3e3637c6c3a5e405a1bf9c25a"}
Sep 15 12:02:04.242382 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.242299    2564 scope.go:117] "RemoveContainer" containerID="e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b"
Sep 15 12:02:04.242752 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.242728    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"
Sep 15 12:02:04.256388 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.256365    2564 scope.go:117] "RemoveContainer" containerID="e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b"
Sep 15 12:02:04.256702 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:02:04.256681    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b\": container with ID starting with e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b not found: ID does not exist" containerID="e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b"
Sep 15 12:02:04.256765 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.256712    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b"} err="failed to get container status \"e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b\": rpc error: code = NotFound desc = could not find container \"e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b\": container with ID starting with e6dec9556cca54785223963861430e1ad8eadbf88f662a3ee72b616f71e3f70b not found: ID does not exist"
Sep 15 12:02:04.272628 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.272592    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"]
Sep 15 12:02:04.279738 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.279710    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc097cc5-b9bff8c5-8dxz5"]
Sep 15 12:02:04.756528 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.756495    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03c88523-8ca9-4377-b017-8daf63dc3f54" path="/var/lib/kubelet/pods/03c88523-8ca9-4377-b017-8daf63dc3f54/volumes"
Sep 15 12:02:04.756908 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:04.756819    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf6aca13-229b-4dbf-b571-3acf6520eca3" path="/var/lib/kubelet/pods/bf6aca13-229b-4dbf-b571-3acf6520eca3/volumes"
Sep 15 12:02:06.484093 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:06.484060    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:02:07.544919 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:07.544881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:07.608609 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:07.608574    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:07.901002 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:07.900915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:08.001440 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:08.001411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:08.716363 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:08.716333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:09.599236 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:09.599192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:10.460377 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:10.460342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:11.265706 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:11.265657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:11.872827 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:11.872794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:12.226860 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:12.226807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:14.785949 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:14.785915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:17.327203 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:17.327107    2564 generic.go:356] "Generic (PLEG): container finished" podID="87077052-39a9-4488-9b69-4c3cd36c4240" containerID="0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc" exitCode=0
Sep 15 12:02:17.327203 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:17.327188    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" event={"ID":"87077052-39a9-4488-9b69-4c3cd36c4240","Type":"ContainerDied","Data":"0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc"}
Sep 15 12:02:17.327672 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:17.327656    2564 scope.go:117] "RemoveContainer" containerID="0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc"
Sep 15 12:02:17.329048 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:17.329018    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:02:17.329128 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:17.329089    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:02:17.329166 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:17.329124    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:02:18.335757 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:18.335718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" event={"ID":"87077052-39a9-4488-9b69-4c3cd36c4240","Type":"ContainerStarted","Data":"2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e"}
Sep 15 12:02:18.825018 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:18.824986    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:02:18.825313 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:18.825290    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 12:02:18.825379 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:18.825342    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 12:02:19.825181 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:19.825147    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 12:02:19.825607 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:19.825206    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 12:02:20.433273 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:20.433235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:20.534087 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:20.534058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:20.825694 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:20.825659    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 12:02:20.826068 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:20.825741    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 12:02:21.825442 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:21.825408    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 12:02:21.825625 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:21.825471    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 12:02:22.825015 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:22.824981    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 12:02:22.825409 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:22.825039    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 12:02:23.825089 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:23.825046    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 15 12:02:23.825557 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:23.825124    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 15 12:02:24.829138 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:24.829106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:02:24.829540 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:24.829381    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:02:24.829971 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:24.829951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:02:33.257955 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:33.257922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:35.077187 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:35.077141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:39.524677 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:39.524641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:46.767245 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:46.767189    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:02:48.898980 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:48.898949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:51.159078 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:02:51.159036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:02.438454 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:02.438418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:08.394714 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:08.394675    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:15.290179 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:15.290141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:15.396502 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:15.396468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:15.523088 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:15.523056    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"]
Sep 15 12:03:15.523306 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:15.523280    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy" containerID="cri-o://9234e99c34c33552752b101daf67cef67f7978f234a841104e72f55c94a45ea9" gracePeriod=30
Sep 15 12:03:15.571395 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:15.571306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:16.798041 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:16.798001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:16.993306 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:16.993254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:17.609095 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:17.609055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:17.730119 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:17.730082    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:19.145697 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:19.145668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:20.700039 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.699993    2564 generic.go:356] "Generic (PLEG): container finished" podID="79d8db78-1100-4b94-9633-ccc500ae5857" containerID="9234e99c34c33552752b101daf67cef67f7978f234a841104e72f55c94a45ea9" exitCode=0
Sep 15 12:03:20.700485 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.700094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" event={"ID":"79d8db78-1100-4b94-9633-ccc500ae5857","Type":"ContainerDied","Data":"9234e99c34c33552752b101daf67cef67f7978f234a841104e72f55c94a45ea9"}
Sep 15 12:03:20.700485 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.700201    2564 scope.go:117] "RemoveContainer" containerID="9974182306fe9a80f30172b0d54baa88b571d09130e0fcfa3e18fe55ac1bbb98"
Sep 15 12:03:20.776096 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.776075    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 12:03:20.925490 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925416    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-envoy\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925490 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925466    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-certs\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925687 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925505    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-data\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925687 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925535    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d8db78-1100-4b94-9633-ccc500ae5857-istio-podinfo\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925687 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925563    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d8db78-1100-4b94-9633-ccc500ae5857-istiod-ca-cert\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925687 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925602    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-istio-token\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925687 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925679    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-socket\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925704    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-credential-socket\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:20.925944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925883    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-data" (OuterVolumeSpecName: "istio-data") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:20.925944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925894    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvz2q\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-kube-api-access-jvz2q\") pod \"79d8db78-1100-4b94-9633-ccc500ae5857\" (UID: \"79d8db78-1100-4b94-9633-ccc500ae5857\") "
Sep 15 12:03:20.925944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.925926    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:20.926232 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.926047    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:20.926346 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.926319    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79d8db78-1100-4b94-9633-ccc500ae5857-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:03:20.926471 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.926389    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:20.926471 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.926402    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:20.926471 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.926412    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:20.926471 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.926421    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:20.927890 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.927864    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:03:20.927993 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.927964    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-kube-api-access-jvz2q" (OuterVolumeSpecName: "kube-api-access-jvz2q") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "kube-api-access-jvz2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:03:20.928151 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.928130    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79d8db78-1100-4b94-9633-ccc500ae5857-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:03:20.928242 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:20.928162    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-istio-token" (OuterVolumeSpecName: "istio-token") pod "79d8db78-1100-4b94-9633-ccc500ae5857" (UID: "79d8db78-1100-4b94-9633-ccc500ae5857"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:03:21.027241 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.027203    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:21.027241 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.027241    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvz2q\" (UniqueName: \"kubernetes.io/projected/79d8db78-1100-4b94-9633-ccc500ae5857-kube-api-access-jvz2q\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:21.027241 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.027252    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d8db78-1100-4b94-9633-ccc500ae5857-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:21.027526 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.027262    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d8db78-1100-4b94-9633-ccc500ae5857-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:21.027526 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.027269    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d8db78-1100-4b94-9633-ccc500ae5857-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:03:21.183800 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.183706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:21.709687 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.709657    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"
Sep 15 12:03:21.709687 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.709687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh" event={"ID":"79d8db78-1100-4b94-9633-ccc500ae5857","Type":"ContainerDied","Data":"afe2fab2d115036952ec1aecdc3254a9c23e6dbf00c908eb182c987c1f65fefa"}
Sep 15 12:03:21.710205 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.709739    2564 scope.go:117] "RemoveContainer" containerID="9234e99c34c33552752b101daf67cef67f7978f234a841104e72f55c94a45ea9"
Sep 15 12:03:21.734365 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.734339    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"]
Sep 15 12:03:21.742658 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:21.742637    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh"]
Sep 15 12:03:22.761268 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:22.761213    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" path="/var/lib/kubelet/pods/79d8db78-1100-4b94-9633-ccc500ae5857/volumes"
Sep 15 12:03:25.444039 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:25.443993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:25.522048 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:25.522021    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:26.000755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:26.000722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:03:26.125621 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:26.125589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:26.233793 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:26.233762    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:27.717093 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:27.717044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:33.346961 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:33.346926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:33.453047 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:33.453004    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:33.558143 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:33.558114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:41.700684 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.700653    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"]
Sep 15 12:03:41.701161 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701102    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy"
Sep 15 12:03:41.701161 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701114    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy"
Sep 15 12:03:41.701161 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701122    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c88523-8ca9-4377-b017-8daf63dc3f54" containerName="maas-api"
Sep 15 12:03:41.701161 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701128    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c88523-8ca9-4377-b017-8daf63dc3f54" containerName="maas-api"
Sep 15 12:03:41.701161 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701139    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy"
Sep 15 12:03:41.701161 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701145    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy"
Sep 15 12:03:41.701384 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701248    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy"
Sep 15 12:03:41.701384 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701257    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="79d8db78-1100-4b94-9633-ccc500ae5857" containerName="istio-proxy"
Sep 15 12:03:41.701384 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.701264    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="03c88523-8ca9-4377-b017-8daf63dc3f54" containerName="maas-api"
Sep 15 12:03:41.704569 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.704555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.707946 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.707924    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-32bbbb\"/\"default-dockercfg-l95jw\""
Sep 15 12:03:41.707946 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.707935    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-32bbbb\"/\"openshift-service-ca.crt\""
Sep 15 12:03:41.708142 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.707966    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-32bbbb\"/\"auth-test-model-32bbbb-kserve-self-signed-certs\""
Sep 15 12:03:41.708142 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.708023    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-32bbbb\"/\"kube-root-ca.crt\""
Sep 15 12:03:41.726916 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.726894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"]
Sep 15 12:03:41.746066 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.746044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-tmp-dir\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.746193 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.746107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vlwk\" (UniqueName: \"kubernetes.io/projected/d570484d-7066-4e4a-8114-d5e05c27d2aa-kube-api-access-4vlwk\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.746193 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.746151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-home\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.746193 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.746175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-model-cache\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.746340 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.746298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d570484d-7066-4e4a-8114-d5e05c27d2aa-tls-certs\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.746419 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.746400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-dshm\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.749296 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.749260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:41.849061 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.848871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d570484d-7066-4e4a-8114-d5e05c27d2aa-tls-certs\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.849413 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.849392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-dshm\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.851755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.849994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-tmp-dir\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.851755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.850058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vlwk\" (UniqueName: \"kubernetes.io/projected/d570484d-7066-4e4a-8114-d5e05c27d2aa-kube-api-access-4vlwk\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.851755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.850088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-home\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.851755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.850110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-model-cache\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.851755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.850476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-model-cache\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.851755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.851155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-tmp-dir\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.851755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.851720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-home\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.871129 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.870788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vlwk\" (UniqueName: \"kubernetes.io/projected/d570484d-7066-4e4a-8114-d5e05c27d2aa-kube-api-access-4vlwk\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.871129 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.870786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d570484d-7066-4e4a-8114-d5e05c27d2aa-tls-certs\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:41.871581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:41.871561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-dshm\") pod \"auth-test-model-32bbbb-kserve-9f7b976b7-tft4f\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") " pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:42.014154 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:42.014066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:42.292862 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:42.292837    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"]
Sep 15 12:03:42.294997 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:03:42.294971    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd570484d_7066_4e4a_8114_d5e05c27d2aa.slice/crio-bd03d20032436f46df9cdbdc37f119dbbe54cfb895a85e0315dc0072f9447cae WatchSource:0}: Error finding container bd03d20032436f46df9cdbdc37f119dbbe54cfb895a85e0315dc0072f9447cae: Status 404 returned error can't find the container with id bd03d20032436f46df9cdbdc37f119dbbe54cfb895a85e0315dc0072f9447cae
Sep 15 12:03:42.825406 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:42.825371    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f" event={"ID":"d570484d-7066-4e4a-8114-d5e05c27d2aa","Type":"ContainerStarted","Data":"ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2"}
Sep 15 12:03:42.825406 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:42.825414    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f" event={"ID":"d570484d-7066-4e4a-8114-d5e05c27d2aa","Type":"ContainerStarted","Data":"bd03d20032436f46df9cdbdc37f119dbbe54cfb895a85e0315dc0072f9447cae"}
Sep 15 12:03:42.845420 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:42.845374    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f" podStartSLOduration=1.84536078 podStartE2EDuration="1.84536078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:03:42.843827221 +0000 UTC m=+1520.567568908" watchObservedRunningTime="2026-09-15 12:03:42.84536078 +0000 UTC m=+1520.569102466"
Sep 15 12:03:43.194169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:43.194140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:44.035364 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:44.035335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:44.253267 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:44.253236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:52.014784 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:52.014703    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:52.014784 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:52.014748    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:52.028558 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:52.028527    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:52.893059 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:52.893031    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:03:56.970685 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:56.970650    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:03:58.760427 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:03:58.760395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:05.143916 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:05.143878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:11.906265 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:11.906214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:12.000168 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.000124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:12.245386 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.245353    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:12.539345 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.539266    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"]
Sep 15 12:04:12.543404 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.543385    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.546944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.546926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-25d1cb-openshift-default-dockercfg-rk77k\""
Sep 15 12:04:12.556839 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.556816    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"]
Sep 15 12:04:12.577162 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.577128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:12.577808 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.577781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-credential-socket\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.577944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.577820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-socket\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.577944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.577903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg4rd\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-kube-api-access-tg4rd\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.578046 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.577993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-data\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.578046 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.578021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-istio-token\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.578125 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.578105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45998b63-9a30-447a-83be-e41c1868021c-istiod-ca-cert\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.578191 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.578151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-certs\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.578316 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.578299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45998b63-9a30-447a-83be-e41c1868021c-istio-podinfo\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.578361 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.578325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-envoy\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.679840 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.679801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg4rd\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-kube-api-access-tg4rd\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680150 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.679866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-data\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680150 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.679889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-istio-token\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680150 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.679914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45998b63-9a30-447a-83be-e41c1868021c-istiod-ca-cert\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680150 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.679946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-certs\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680150 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45998b63-9a30-447a-83be-e41c1868021c-istio-podinfo\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680150 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-envoy\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680514 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-credential-socket\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680514 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-socket\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680514 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680378    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-data\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680514 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-certs\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680720 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-credential-socket\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680720 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680649    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-socket\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.680804 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.680782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45998b63-9a30-447a-83be-e41c1868021c-istiod-ca-cert\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.682338 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.682317    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-envoy\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.682569 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.682554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45998b63-9a30-447a-83be-e41c1868021c-istio-podinfo\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.690202 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.690177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg4rd\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-kube-api-access-tg4rd\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.690335 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.690318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-istio-token\") pod \"e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") " pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:12.857238 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:12.857135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:13.123212 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:13.123114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:13.136442 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:13.136192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"]
Sep 15 12:04:13.144476 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:13.143797    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:13.144476 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:13.143882    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:13.144476 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:13.143928    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:13.996023 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:13.995988    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" event={"ID":"45998b63-9a30-447a-83be-e41c1868021c","Type":"ContainerStarted","Data":"475d68fba784d29ed74e90d3eb6eff47a716dae8879795fe05bc957fa3a333bd"}
Sep 15 12:04:13.996211 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:13.996049    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" event={"ID":"45998b63-9a30-447a-83be-e41c1868021c","Type":"ContainerStarted","Data":"3178df7675e77aafccd2784b94f28f674380863663837d210825a7072b54f9a1"}
Sep 15 12:04:14.019994 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:14.019931    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" podStartSLOduration=2.019914579 podStartE2EDuration="2.019914579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:04:14.018366232 +0000 UTC m=+1551.742107918" watchObservedRunningTime="2026-09-15 12:04:14.019914579 +0000 UTC m=+1551.743656327"
Sep 15 12:04:14.858326 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:14.858292    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:14.863439 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:14.863416    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:15.001505 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:15.001464    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:15.002507 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:15.002484    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:15.323324 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:15.323290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:15.961566 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:15.961521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:16.078152 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:16.078116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:16.414789 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:16.414698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:17.289727 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:17.289689    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:18.047400 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:18.047341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:21.300959 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:21.300910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:21.376779 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:21.376747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:21.778368 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:21.778337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:21.872393 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:21.872364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:21.972122 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:21.972090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:30.272971 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:30.272940    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:32.972009 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:32.971975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:04:42.398234 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:42.398164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:45.003562 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:45.003526    2564 patch_prober.go:28] interesting pod/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 12:04:45.003989 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:45.003609    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 12:04:45.199699 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:45.199664    2564 generic.go:356] "Generic (PLEG): container finished" podID="45998b63-9a30-447a-83be-e41c1868021c" containerID="475d68fba784d29ed74e90d3eb6eff47a716dae8879795fe05bc957fa3a333bd" exitCode=0
Sep 15 12:04:45.199875 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:45.199734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" event={"ID":"45998b63-9a30-447a-83be-e41c1868021c","Type":"ContainerDied","Data":"475d68fba784d29ed74e90d3eb6eff47a716dae8879795fe05bc957fa3a333bd"}
Sep 15 12:04:45.200196 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:45.200182    2564 scope.go:117] "RemoveContainer" containerID="475d68fba784d29ed74e90d3eb6eff47a716dae8879795fe05bc957fa3a333bd"
Sep 15 12:04:45.201371 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:45.201345    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:45.201437 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:45.201409    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:45.201474 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:45.201440    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:46.207314 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.207279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" event={"ID":"45998b63-9a30-447a-83be-e41c1868021c","Type":"ContainerStarted","Data":"fed8a5096a063156f6e97aec8923fbc0051fdae2d196c9e8e349cee818706cbf"}
Sep 15 12:04:46.844706 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.844676    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"]
Sep 15 12:04:46.847769 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.847744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.856929 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.856870    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0848f9-openshift-default-dockercfg-p8nwr\""
Sep 15 12:04:46.857622 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.857503    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:46.858100 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.857833    2564 patch_prober.go:28] interesting pod/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 12:04:46.858100 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.857883    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 12:04:46.866952 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.866797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"]
Sep 15 12:04:46.973784 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.973733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-certs\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.974102 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.974083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-socket\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.974258 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.974240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-podinfo\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.974409 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.974392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istiod-ca-cert\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.974545 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.974530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-credential-socket\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.974714 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.974687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-data\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.974841 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.974827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-token\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.974977 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.974963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xblp9\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-kube-api-access-xblp9\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:46.975131 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:46.975111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-envoy\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.002239 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.001709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:47.076121 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-certs\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076121 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-socket\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076413 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-podinfo\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076413 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istiod-ca-cert\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076413 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-credential-socket\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076413 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-data\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076557 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-token\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076557 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblp9\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-kube-api-access-xblp9\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076557 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076525    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-envoy\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.076557 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.076536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-certs\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.077104 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.077056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-credential-socket\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.077259 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.077124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-socket\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.077318 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.077278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-data\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.077493 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.077444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istiod-ca-cert\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.078877 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.078857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-envoy\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.079093 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.079075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-podinfo\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.096097 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.096042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-token\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.096275 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.096257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xblp9\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-kube-api-access-xblp9\") pod \"e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") " pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.104311 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.104282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:47.172580 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.172542    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:47.305723 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.305670    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:47.496434 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.496408    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"]
Sep 15 12:04:47.498056 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:04:47.498034    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9ff3cf_6487_4a58_8b71_9d33237a2351.slice/crio-58b46d31d483bc970a5e33be54795d49f010b9ef69fd1239645b5251fe2a1a57 WatchSource:0}: Error finding container 58b46d31d483bc970a5e33be54795d49f010b9ef69fd1239645b5251fe2a1a57: Status 404 returned error can't find the container with id 58b46d31d483bc970a5e33be54795d49f010b9ef69fd1239645b5251fe2a1a57
Sep 15 12:04:47.500534 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.500501    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:47.500614 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.500569    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:47.500614 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.500599    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:04:47.858069 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.857972    2564 patch_prober.go:28] interesting pod/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 12:04:47.858069 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:47.858039    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 12:04:48.220664 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:48.220630    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" event={"ID":"3b9ff3cf-6487-4a58-8b71-9d33237a2351","Type":"ContainerStarted","Data":"a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be"}
Sep 15 12:04:48.220848 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:48.220682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" event={"ID":"3b9ff3cf-6487-4a58-8b71-9d33237a2351","Type":"ContainerStarted","Data":"58b46d31d483bc970a5e33be54795d49f010b9ef69fd1239645b5251fe2a1a57"}
Sep 15 12:04:48.433077 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:48.433043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:48.870245 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:48.861236    2564 patch_prober.go:28] interesting pod/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 12:04:48.870245 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:48.861331    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 12:04:49.173698 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:49.173609    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:49.179025 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:49.178996    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:49.206121 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:49.206065    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podStartSLOduration=3.206043348 podStartE2EDuration="3.206043348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:04:48.262414765 +0000 UTC m=+1585.986156456" watchObservedRunningTime="2026-09-15 12:04:49.206043348 +0000 UTC m=+1586.929785034"
Sep 15 12:04:49.226561 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:49.226533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:49.227474 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:49.227456    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:04:49.719075 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:49.719046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:49.857928 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:49.857886    2564 patch_prober.go:28] interesting pod/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 12:04:49.858254 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:49.858199    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 12:04:50.858135 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:50.858089    2564 patch_prober.go:28] interesting pod/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 12:04:50.858680 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:50.858176    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 12:04:51.804035 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.803989    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"]
Sep 15 12:04:51.806764 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.806749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:51.809067 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.809047    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0848f9-serving-cert\""
Sep 15 12:04:51.820768 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.820743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"]
Sep 15 12:04:51.861870 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.861842    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:51.862252 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.862099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:51.862724 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.862708    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:04:51.934270 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.934232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-maas-api-tls\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:51.934531 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.934513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-metrics-certs\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:51.934758 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.934736    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242571be-2a8c-428e-a17f-eb9752043261-openshift-service-ca\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:51.934906 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:51.934888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xmzh\" (UniqueName: \"kubernetes.io/projected/242571be-2a8c-428e-a17f-eb9752043261-kube-api-access-4xmzh\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.036069 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.036032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-maas-api-tls\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.036278 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.036103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-metrics-certs\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.036278 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.036262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242571be-2a8c-428e-a17f-eb9752043261-openshift-service-ca\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.036440 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.036298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xmzh\" (UniqueName: \"kubernetes.io/projected/242571be-2a8c-428e-a17f-eb9752043261-kube-api-access-4xmzh\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.036967 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.036941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242571be-2a8c-428e-a17f-eb9752043261-openshift-service-ca\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.040564 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.039116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-metrics-certs\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.049572 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.044507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-maas-api-tls\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.068498 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.067886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xmzh\" (UniqueName: \"kubernetes.io/projected/242571be-2a8c-428e-a17f-eb9752043261-kube-api-access-4xmzh\") pod \"maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.117957 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.117930    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:52.399147 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.399118    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"]
Sep 15 12:04:52.400779 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:04:52.400756    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242571be_2a8c_428e_a17f_eb9752043261.slice/crio-b855e45b04a910c49c1f2349aa680883ca521472a55c4d8d83a96b6b2d2ae4f2 WatchSource:0}: Error finding container b855e45b04a910c49c1f2349aa680883ca521472a55c4d8d83a96b6b2d2ae4f2: Status 404 returned error can't find the container with id b855e45b04a910c49c1f2349aa680883ca521472a55c4d8d83a96b6b2d2ae4f2
Sep 15 12:04:52.402278 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:52.402257    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:04:53.119018 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:53.118905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:53.219979 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:53.219928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:53.256450 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:53.256415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c" event={"ID":"242571be-2a8c-428e-a17f-eb9752043261","Type":"ContainerStarted","Data":"9515b3f9772be9e8ba32a60e38448c2f1a6d305319c023a7ccc6e5682a330a3f"}
Sep 15 12:04:53.256644 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:53.256494    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c" event={"ID":"242571be-2a8c-428e-a17f-eb9752043261","Type":"ContainerStarted","Data":"b855e45b04a910c49c1f2349aa680883ca521472a55c4d8d83a96b6b2d2ae4f2"}
Sep 15 12:04:53.256644 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:53.256596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:04:53.280996 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:53.280363    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c" podStartSLOduration=1.9857211270000001 podStartE2EDuration="2.280337772s" totalImagesPullingTime="294.616645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:04:53.276869758 +0000 UTC m=+1591.000611446" watchObservedRunningTime="2026-09-15 12:04:53.280337772 +0000 UTC m=+1591.004079459"
Sep 15 12:04:53.323730 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:53.323697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:54.193891 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:54.193857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:55.165422 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:55.165391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:56.131889 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:56.131854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:57.178806 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:57.178776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:58.142171 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:58.142140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:59.034944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:59.034914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:59.272780 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:04:59.272748    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:05:02.830583 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:02.830547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:02.928141 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:02.928094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:03.381804 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:03.381774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:04.302200 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:04.302165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:04.996433 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:04.996400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:05.268633 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:05.268541    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:06.025870 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:06.025832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:06.921636 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:06.921599    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:07.692352 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:07.692315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:08.572585 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:08.572553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:09.395707 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:09.395675    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:05:09.514875 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:09.514840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:10.458700 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:10.458666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:11.376310 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:11.376277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:12.403098 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:12.403060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:13.179230 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:13.179176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:14.114028 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:14.113983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:14.927926 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:14.927895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:15.708270 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:15.708236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:16.484804 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:16.484768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:18.107993 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:18.107951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:20.268371 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:20.268337    2564 patch_prober.go:28] interesting pod/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 12:05:20.268740 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:20.268431    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 12:05:20.426683 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:20.426659    2564 generic.go:356] "Generic (PLEG): container finished" podID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerID="a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be" exitCode=0
Sep 15 12:05:20.426836 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:20.426736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" event={"ID":"3b9ff3cf-6487-4a58-8b71-9d33237a2351","Type":"ContainerDied","Data":"a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be"}
Sep 15 12:05:20.427214 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:20.427200    2564 scope.go:117] "RemoveContainer" containerID="a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be"
Sep 15 12:05:20.428527 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:20.428497    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:05:20.428639 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:20.428580    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:05:20.428639 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:20.428629    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:05:21.433979 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:21.433943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" event={"ID":"3b9ff3cf-6487-4a58-8b71-9d33237a2351","Type":"ContainerStarted","Data":"61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375"}
Sep 15 12:05:22.173151 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:22.173105    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:05:22.173388 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:22.173364    2564 patch_prober.go:28] interesting pod/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 12:05:22.173468 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:22.173450    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 12:05:23.172987 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:23.172948    2564 patch_prober.go:28] interesting pod/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 12:05:23.173514 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:23.173027    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 12:05:23.798493 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:23.798443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:23.885180 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:23.885142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:23.967052 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:23.967017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:24.037757 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:24.037712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:24.106522 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:24.106444    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:24.175301 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:24.175248    2564 patch_prober.go:28] interesting pod/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 12:05:24.175755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:24.175345    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 12:05:24.430993 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:24.430885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:24.531086 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:24.531045    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:25.173456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:25.173421    2564 patch_prober.go:28] interesting pod/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 12:05:25.173661 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:25.173484    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 12:05:25.316389 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:25.316354    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:26.069917 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:26.069881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:26.173140 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:26.173095    2564 patch_prober.go:28] interesting pod/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 12:05:26.173346 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:26.173171    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 12:05:26.898344 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:26.898310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:27.177372 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:27.177298    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:05:27.177693 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:27.177672    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:05:27.178396 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:27.178381    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:05:27.805101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:27.805067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:28.591402 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:28.591369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:29.503067 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:29.503033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:30.335607 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:30.335572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:31.097552 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:31.097518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:31.166659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:31.166623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:31.364356 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:31.364281    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"]
Sep 15 12:05:31.364734 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:31.364577    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy" containerID="cri-o://fed8a5096a063156f6e97aec8923fbc0051fdae2d196c9e8e349cee818706cbf" gracePeriod=30
Sep 15 12:05:31.389279 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:31.389255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:32.033386 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:32.033349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:32.821902 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:32.821869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:32.921713 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:32.921681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:33.022807 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:33.022774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:34.118233 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:34.118185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:34.881399 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:34.881369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:35.823190 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:35.823157    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:36.541959 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.541925    2564 generic.go:356] "Generic (PLEG): container finished" podID="45998b63-9a30-447a-83be-e41c1868021c" containerID="fed8a5096a063156f6e97aec8923fbc0051fdae2d196c9e8e349cee818706cbf" exitCode=0
Sep 15 12:05:36.542097 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.541983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" event={"ID":"45998b63-9a30-447a-83be-e41c1868021c","Type":"ContainerDied","Data":"fed8a5096a063156f6e97aec8923fbc0051fdae2d196c9e8e349cee818706cbf"}
Sep 15 12:05:36.542097 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.542046    2564 scope.go:117] "RemoveContainer" containerID="475d68fba784d29ed74e90d3eb6eff47a716dae8879795fe05bc957fa3a333bd"
Sep 15 12:05:36.629011 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.628957    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:05:36.738468 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738439    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-data\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.738632 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738494    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-socket\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.738632 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738553    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg4rd\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-kube-api-access-tg4rd\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.738632 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738579    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-certs\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.738786 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738647    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45998b63-9a30-447a-83be-e41c1868021c-istiod-ca-cert\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.738786 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738697    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-envoy\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.738786 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738736    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45998b63-9a30-447a-83be-e41c1868021c-istio-podinfo\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.738786 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738737    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-data" (OuterVolumeSpecName: "istio-data") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:36.738786 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738773    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-credential-socket\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.739047 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738804    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-istio-token\") pod \"45998b63-9a30-447a-83be-e41c1868021c\" (UID: \"45998b63-9a30-447a-83be-e41c1868021c\") "
Sep 15 12:05:36.739047 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:36.739047 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.738961    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:36.739196 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.739082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:36.739196 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.739126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45998b63-9a30-447a-83be-e41c1868021c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:36.739343 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.739324    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45998b63-9a30-447a-83be-e41c1868021c-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:36.739393 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.739345    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:36.739393 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.739355    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:36.739393 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.739367    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:36.739393 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.739377    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:36.741303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.741278    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-kube-api-access-tg4rd" (OuterVolumeSpecName: "kube-api-access-tg4rd") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "kube-api-access-tg4rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:36.741303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.741282    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45998b63-9a30-447a-83be-e41c1868021c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:05:36.741467 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.741441    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:36.741513 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.741467    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-istio-token" (OuterVolumeSpecName: "istio-token") pod "45998b63-9a30-447a-83be-e41c1868021c" (UID: "45998b63-9a30-447a-83be-e41c1868021c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:36.823038 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.823012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:36.840860 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.840841    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45998b63-9a30-447a-83be-e41c1868021c-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:36.840860 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.840861    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45998b63-9a30-447a-83be-e41c1868021c-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:36.841183 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.840869    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:36.841183 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:36.840877    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg4rd\" (UniqueName: \"kubernetes.io/projected/45998b63-9a30-447a-83be-e41c1868021c-kube-api-access-tg4rd\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:37.548448 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:37.548417    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"
Sep 15 12:05:37.548624 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:37.548462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d" event={"ID":"45998b63-9a30-447a-83be-e41c1868021c","Type":"ContainerDied","Data":"3178df7675e77aafccd2784b94f28f674380863663837d210825a7072b54f9a1"}
Sep 15 12:05:37.548624 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:37.548521    2564 scope.go:117] "RemoveContainer" containerID="fed8a5096a063156f6e97aec8923fbc0051fdae2d196c9e8e349cee818706cbf"
Sep 15 12:05:37.569582 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:37.569559    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"]
Sep 15 12:05:37.574377 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:37.574354    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d"]
Sep 15 12:05:37.678461 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:37.678431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:38.451789 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:38.451756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:38.757684 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:38.757593    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45998b63-9a30-447a-83be-e41c1868021c" path="/var/lib/kubelet/pods/45998b63-9a30-447a-83be-e41c1868021c/volumes"
Sep 15 12:05:39.364471 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:39.364442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:41.487029 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:41.486989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:47.384799 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.384751    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"]
Sep 15 12:05:47.385440 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.385068    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c" podUID="242571be-2a8c-428e-a17f-eb9752043261" containerName="maas-api" containerID="cri-o://9515b3f9772be9e8ba32a60e38448c2f1a6d305319c023a7ccc6e5682a330a3f" gracePeriod=30
Sep 15 12:05:47.411149 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.411110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:47.535670 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.535637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:47.613007 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.612974    2564 generic.go:356] "Generic (PLEG): container finished" podID="242571be-2a8c-428e-a17f-eb9752043261" containerID="9515b3f9772be9e8ba32a60e38448c2f1a6d305319c023a7ccc6e5682a330a3f" exitCode=0
Sep 15 12:05:47.613187 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.613020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c" event={"ID":"242571be-2a8c-428e-a17f-eb9752043261","Type":"ContainerDied","Data":"9515b3f9772be9e8ba32a60e38448c2f1a6d305319c023a7ccc6e5682a330a3f"}
Sep 15 12:05:47.636182 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.636117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:47.652537 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.652511    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:05:47.727955 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.727910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:47.755014 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.754985    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-metrics-certs\") pod \"242571be-2a8c-428e-a17f-eb9752043261\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") "
Sep 15 12:05:47.755177 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.755100    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-maas-api-tls\") pod \"242571be-2a8c-428e-a17f-eb9752043261\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") "
Sep 15 12:05:47.755177 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.755146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242571be-2a8c-428e-a17f-eb9752043261-openshift-service-ca\") pod \"242571be-2a8c-428e-a17f-eb9752043261\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") "
Sep 15 12:05:47.755347 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.755200    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xmzh\" (UniqueName: \"kubernetes.io/projected/242571be-2a8c-428e-a17f-eb9752043261-kube-api-access-4xmzh\") pod \"242571be-2a8c-428e-a17f-eb9752043261\" (UID: \"242571be-2a8c-428e-a17f-eb9752043261\") "
Sep 15 12:05:47.755595 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.755558    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242571be-2a8c-428e-a17f-eb9752043261-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "242571be-2a8c-428e-a17f-eb9752043261" (UID: "242571be-2a8c-428e-a17f-eb9752043261"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:47.755762 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.755735    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242571be-2a8c-428e-a17f-eb9752043261-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:47.757231 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.757193    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "242571be-2a8c-428e-a17f-eb9752043261" (UID: "242571be-2a8c-428e-a17f-eb9752043261"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:47.757231 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.757206    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "242571be-2a8c-428e-a17f-eb9752043261" (UID: "242571be-2a8c-428e-a17f-eb9752043261"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:47.757419 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.757402    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/242571be-2a8c-428e-a17f-eb9752043261-kube-api-access-4xmzh" (OuterVolumeSpecName: "kube-api-access-4xmzh") pod "242571be-2a8c-428e-a17f-eb9752043261" (UID: "242571be-2a8c-428e-a17f-eb9752043261"). InnerVolumeSpecName "kube-api-access-4xmzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:47.857085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.857037    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:47.857085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.857068    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xmzh\" (UniqueName: \"kubernetes.io/projected/242571be-2a8c-428e-a17f-eb9752043261-kube-api-access-4xmzh\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:47.857085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:47.857078    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/242571be-2a8c-428e-a17f-eb9752043261-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:05:48.031252 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:48.031190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:48.204722 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:48.204686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:48.619162 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:48.619130    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"
Sep 15 12:05:48.619641 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:48.619164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c" event={"ID":"242571be-2a8c-428e-a17f-eb9752043261","Type":"ContainerDied","Data":"b855e45b04a910c49c1f2349aa680883ca521472a55c4d8d83a96b6b2d2ae4f2"}
Sep 15 12:05:48.619641 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:48.619245    2564 scope.go:117] "RemoveContainer" containerID="9515b3f9772be9e8ba32a60e38448c2f1a6d305319c023a7ccc6e5682a330a3f"
Sep 15 12:05:48.644335 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:48.644308    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"]
Sep 15 12:05:48.653992 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:48.653968    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0848f9-69bfbdcc9f-p8l2c"]
Sep 15 12:05:48.757357 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:48.757329    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="242571be-2a8c-428e-a17f-eb9752043261" path="/var/lib/kubelet/pods/242571be-2a8c-428e-a17f-eb9752043261/volumes"
Sep 15 12:05:49.134711 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:49.134668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:50.107308 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:50.107268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:50.924374 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:50.924334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:51.912513 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:51.912479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:53.083567 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:53.083523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:53.847025 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:53.846994    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:55.418371 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:55.418341    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"]
Sep 15 12:05:55.418770 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:55.418549    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy" containerID="cri-o://61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375" gracePeriod=30
Sep 15 12:05:57.179730 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:57.179688    2564 patch_prober.go:28] interesting pod/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:05:57.180234 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:57.179761    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:05:57.983190 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:05:57.983150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:00.671802 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.671777    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:06:00.688937 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.688909    2564 generic.go:356] "Generic (PLEG): container finished" podID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerID="61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375" exitCode=0
Sep 15 12:06:00.689072 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.688948    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" event={"ID":"3b9ff3cf-6487-4a58-8b71-9d33237a2351","Type":"ContainerDied","Data":"61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375"}
Sep 15 12:06:00.689072 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.689007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv" event={"ID":"3b9ff3cf-6487-4a58-8b71-9d33237a2351","Type":"ContainerDied","Data":"58b46d31d483bc970a5e33be54795d49f010b9ef69fd1239645b5251fe2a1a57"}
Sep 15 12:06:00.689072 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.688957    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"
Sep 15 12:06:00.689072 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.689031    2564 scope.go:117] "RemoveContainer" containerID="61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375"
Sep 15 12:06:00.700095 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.700067    2564 scope.go:117] "RemoveContainer" containerID="a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be"
Sep 15 12:06:00.704619 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-podinfo\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.704718 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704702    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-data\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.704772 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704754    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-certs\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.704827 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704803    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-credential-socket\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.704887 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704837    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-socket\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.704887 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704859    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-envoy\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.705008 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704897    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-token\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.705008 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704924    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istiod-ca-cert\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.705008 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xblp9\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-kube-api-access-xblp9\") pod \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\" (UID: \"3b9ff3cf-6487-4a58-8b71-9d33237a2351\") "
Sep 15 12:06:00.705008 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.704975    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:00.705203 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.705068    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:00.705203 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.705083    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:00.705203 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.705175    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:00.705513 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.705490    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.705581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.705515    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:06:00.705581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.705519    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.705581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.705561    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.705581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.705579    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.707337 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.707298    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-kube-api-access-xblp9" (OuterVolumeSpecName: "kube-api-access-xblp9") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "kube-api-access-xblp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:00.707662 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.707641    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:06:00.707741 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.707694    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:00.707741 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.707707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b9ff3cf-6487-4a58-8b71-9d33237a2351" (UID: "3b9ff3cf-6487-4a58-8b71-9d33237a2351"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:00.710578 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.710559    2564 scope.go:117] "RemoveContainer" containerID="61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375"
Sep 15 12:06:00.710894 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:06:00.710874    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375\": container with ID starting with 61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375 not found: ID does not exist" containerID="61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375"
Sep 15 12:06:00.710956 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.710901    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375"} err="failed to get container status \"61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375\": rpc error: code = NotFound desc = could not find container \"61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375\": container with ID starting with 61e00b03055fe011f0f055a710830bb926b710bb199445f46a3a922d46626375 not found: ID does not exist"
Sep 15 12:06:00.710956 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.710921    2564 scope.go:117] "RemoveContainer" containerID="a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be"
Sep 15 12:06:00.711203 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:06:00.711181    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be\": container with ID starting with a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be not found: ID does not exist" containerID="a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be"
Sep 15 12:06:00.711267 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.711209    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be"} err="failed to get container status \"a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be\": rpc error: code = NotFound desc = could not find container \"a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be\": container with ID starting with a8023fdff654816bdf10529a51ca67c3f63f45da7ceb1139391c7709cceaf2be not found: ID does not exist"
Sep 15 12:06:00.714654 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.714631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:00.776430 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.776398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:00.806803 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.806740    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.806803 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.806761    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.806803 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.806769    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.806803 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.806776    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b9ff3cf-6487-4a58-8b71-9d33237a2351-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.806803 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.806785    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xblp9\" (UniqueName: \"kubernetes.io/projected/3b9ff3cf-6487-4a58-8b71-9d33237a2351-kube-api-access-xblp9\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:00.875590 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.875561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:00.975779 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:00.975744    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:01.007623 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:01.007592    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"]
Sep 15 12:06:01.012044 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:01.012015    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv"]
Sep 15 12:06:01.574670 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:01.574635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:02.757193 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:02.757160    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" path="/var/lib/kubelet/pods/3b9ff3cf-6487-4a58-8b71-9d33237a2351/volumes"
Sep 15 12:06:05.663644 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:05.663610    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:06:06.274790 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:06.274761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:06.381651 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:06.381611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:06.475400 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:06.475368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:06.575117 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:06.575018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:06.890671 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:06.890593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:07.010424 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:07.010395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:07.789739 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:07.789702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:08.594073 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:08.594016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:09.480623 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:09.480581    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:10.302670 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:10.302635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:11.285500 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:11.285461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:13.219905 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:13.219864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:13.320178 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:13.320150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:13.464478 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:13.464447    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"]
Sep 15 12:06:13.464666 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:13.464629    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy" containerID="cri-o://6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e" gracePeriod=30
Sep 15 12:06:13.478328 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:13.478249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:13.947054 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:13.947020    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:14.144182 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:14.144147    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:06:14.144382 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:14.144209    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:06:14.808345 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:14.808309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:15.685949 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:15.685911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:16.391824 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:16.391787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:17.096334 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:17.096296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:17.994146 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:17.994103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:18.725632 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.725575    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 12:06:18.797015 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.796985    2564 generic.go:356] "Generic (PLEG): container finished" podID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerID="6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e" exitCode=0
Sep 15 12:06:18.797205 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.797037    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"
Sep 15 12:06:18.797205 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.797030    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" event={"ID":"ea1c6eca-19b8-4e31-99df-10104f9be4fc","Type":"ContainerDied","Data":"6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e"}
Sep 15 12:06:18.797205 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.797161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm" event={"ID":"ea1c6eca-19b8-4e31-99df-10104f9be4fc","Type":"ContainerDied","Data":"23c9ac9306cf65f06c4c54677e0a9a0ba7eb0c9fd976a88326883411970db92a"}
Sep 15 12:06:18.797205 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.797185    2564 scope.go:117] "RemoveContainer" containerID="6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e"
Sep 15 12:06:18.802600 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.802573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:18.803568 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803549    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljpnw\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-kube-api-access-ljpnw\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.803666 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803576    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-token\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.803666 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803608    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-certs\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.803666 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803648    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-data\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.803832 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803697    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istiod-ca-cert\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.803832 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-socket\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.803942 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803844    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-credential-socket\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.803942 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803870    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-podinfo\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.803942 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803908    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:18.803942 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803923    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-envoy\") pod \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\" (UID: \"ea1c6eca-19b8-4e31-99df-10104f9be4fc\") "
Sep 15 12:06:18.804157 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.803948    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:18.804157 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.804050    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:18.804157 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.804122    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:18.804383 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.804155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:06:18.804583 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.804484    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:18.804583 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.804510    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:18.804583 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.804525    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:18.804583 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.804540    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:18.804583 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.804554    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:18.805992 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.805968    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-kube-api-access-ljpnw" (OuterVolumeSpecName: "kube-api-access-ljpnw") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "kube-api-access-ljpnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:18.806128 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.806109    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:18.806245 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.806208    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:06:18.806698 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.806678    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea1c6eca-19b8-4e31-99df-10104f9be4fc" (UID: "ea1c6eca-19b8-4e31-99df-10104f9be4fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:18.808206 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.808183    2564 scope.go:117] "RemoveContainer" containerID="cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c"
Sep 15 12:06:18.827155 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.827137    2564 scope.go:117] "RemoveContainer" containerID="6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e"
Sep 15 12:06:18.827484 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:06:18.827461    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e\": container with ID starting with 6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e not found: ID does not exist" containerID="6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e"
Sep 15 12:06:18.827547 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.827499    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e"} err="failed to get container status \"6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e\": rpc error: code = NotFound desc = could not find container \"6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e\": container with ID starting with 6ae25616be39c90a6e4526aefdc6e5621956368f4869fac744a0e9080e18b74e not found: ID does not exist"
Sep 15 12:06:18.827547 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.827522    2564 scope.go:117] "RemoveContainer" containerID="cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c"
Sep 15 12:06:18.827838 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:06:18.827819    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c\": container with ID starting with cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c not found: ID does not exist" containerID="cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c"
Sep 15 12:06:18.827894 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.827844    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c"} err="failed to get container status \"cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c\": rpc error: code = NotFound desc = could not find container \"cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c\": container with ID starting with cd7cc879a2fd3b9ed0c8f8e7f0294e98b14584554b86a26a4ccef990b5f0112c not found: ID does not exist"
Sep 15 12:06:18.905479 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.905448    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:18.905479 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.905474    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:18.905479 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.905483    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljpnw\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-kube-api-access-ljpnw\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:18.905723 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:18.905491    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea1c6eca-19b8-4e31-99df-10104f9be4fc-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:19.120228 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:19.120180    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"]
Sep 15 12:06:19.124353 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:19.124323    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm"]
Sep 15 12:06:20.756711 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:20.756677    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" path="/var/lib/kubelet/pods/ea1c6eca-19b8-4e31-99df-10104f9be4fc/volumes"
Sep 15 12:06:22.973803 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:22.973772    2564 scope.go:117] "RemoveContainer" containerID="034711cb4753e534d86cf1a80e7745ad2265f9cc4c25801998b77ff4532b7be5"
Sep 15 12:06:22.982174 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:22.982154    2564 scope.go:117] "RemoveContainer" containerID="0c95fa53d7f77a5881caf00af4b40099190401edea3c52fcac890cc6d2ddbe11"
Sep 15 12:06:24.382085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:24.382041    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:24.492296 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:24.492263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:24.591275 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:24.591240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:27.018805 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:27.018770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:27.120170 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:27.120135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:27.936639 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:27.936607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:29.122519 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:29.122483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:31.744926 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:31.744891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:31.881396 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:31.881355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:32.003170 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:32.003088    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"]
Sep 15 12:06:32.003427 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:32.003384    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy" containerID="cri-o://8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671" gracePeriod=30
Sep 15 12:06:32.067099 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:32.067053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:33.770146 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:33.770114    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:06:33.770617 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:33.770179    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:06:34.680973 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:34.680921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:37.254085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.254061    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 12:06:37.296484 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296406    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-credential-socket\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.296647 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296502    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-data\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.296647 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296530    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-token\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.296647 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296576    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-podinfo\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.296647 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296617    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zchf2\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-kube-api-access-zchf2\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.296865 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296651    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istiod-ca-cert\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.296865 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296705    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:37.296865 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296713    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-socket\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.296865 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296776    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-certs\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.296865 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-data" (OuterVolumeSpecName: "istio-data") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:37.296865 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.296850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-envoy\") pod \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\" (UID: \"d65c77a3-003e-4e40-998e-aa79fc2d2f39\") "
Sep 15 12:06:37.297456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.297239    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:06:37.297456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.297278    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:37.297456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.297299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:37.297456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.297353    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.297456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.297371    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.299331 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.299305    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-kube-api-access-zchf2" (OuterVolumeSpecName: "kube-api-access-zchf2") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "kube-api-access-zchf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:37.299331 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.299312    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-token" (OuterVolumeSpecName: "istio-token") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:37.299591 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.299568    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:06:37.299830 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.299805    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d65c77a3-003e-4e40-998e-aa79fc2d2f39" (UID: "d65c77a3-003e-4e40-998e-aa79fc2d2f39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:37.398662 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.398620    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.398662 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.398659    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.398662 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.398668    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.398662 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.398677    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.398930 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.398685    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.398930 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.398693    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zchf2\" (UniqueName: \"kubernetes.io/projected/d65c77a3-003e-4e40-998e-aa79fc2d2f39-kube-api-access-zchf2\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.398930 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.398703    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65c77a3-003e-4e40-998e-aa79fc2d2f39-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:06:37.911276 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.911240    2564 generic.go:356] "Generic (PLEG): container finished" podID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerID="8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671" exitCode=0
Sep 15 12:06:37.911460 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.911289    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"
Sep 15 12:06:37.911460 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.911325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" event={"ID":"d65c77a3-003e-4e40-998e-aa79fc2d2f39","Type":"ContainerDied","Data":"8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671"}
Sep 15 12:06:37.911460 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.911382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g" event={"ID":"d65c77a3-003e-4e40-998e-aa79fc2d2f39","Type":"ContainerDied","Data":"dcc5653700693baed7ac77d09b4be9033ca9c93b902a8ecbcae99da2b0587f79"}
Sep 15 12:06:37.911460 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.911406    2564 scope.go:117] "RemoveContainer" containerID="8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671"
Sep 15 12:06:37.921090 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.921072    2564 scope.go:117] "RemoveContainer" containerID="e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c"
Sep 15 12:06:37.929643 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.929625    2564 scope.go:117] "RemoveContainer" containerID="8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671"
Sep 15 12:06:37.929884 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:06:37.929864    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671\": container with ID starting with 8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671 not found: ID does not exist" containerID="8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671"
Sep 15 12:06:37.929935 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.929892    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671"} err="failed to get container status \"8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671\": rpc error: code = NotFound desc = could not find container \"8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671\": container with ID starting with 8f5216ba9d8585f840e009a1fdefddb3a446beb3e4e5d45edd68ed2b9d1c9671 not found: ID does not exist"
Sep 15 12:06:37.929935 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.929909    2564 scope.go:117] "RemoveContainer" containerID="e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c"
Sep 15 12:06:37.930109 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:06:37.930095    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c\": container with ID starting with e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c not found: ID does not exist" containerID="e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c"
Sep 15 12:06:37.930156 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.930115    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c"} err="failed to get container status \"e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c\": rpc error: code = NotFound desc = could not find container \"e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c\": container with ID starting with e6001e7a8e273a8e44fd4abcdf7b7db7adac82c6bef3cb49d7a6b89b59face1c not found: ID does not exist"
Sep 15 12:06:37.933923 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.933901    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"]
Sep 15 12:06:37.938315 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:37.938296    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g"]
Sep 15 12:06:38.757261 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:38.757212    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" path="/var/lib/kubelet/pods/d65c77a3-003e-4e40-998e-aa79fc2d2f39/volumes"
Sep 15 12:06:42.866930 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:42.866895    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:06:46.522901 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:46.522828    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:46.993864 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:46.993831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:47.733598 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:47.733550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:48.591451 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:48.591415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:49.315702 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:49.315663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:50.225493 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:50.225460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:51.061968 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:51.061928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:51.612939 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:06:51.612911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:02.402013 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:02.401977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:02.485095 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:02.485065    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:02.562176 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:02.562143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:02.643200 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:02.643162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:02.707335 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:02.707298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:05.738787 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:05.738751    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:05.837144 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:05.837107    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:09.298039 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:09.298006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:09.366369 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:09.366333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:09.544081 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:09.544047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:11.400592 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:11.400556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:17.457140 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:17.457099    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:07:29.348514 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:29.348469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:29.449420 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:29.449386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:29.809169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:29.809136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:36.036742 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:36.036705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:45.156255 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:45.156211    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:07:45.382538 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:45.382505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:53.876439 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:53.876401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:53.978193 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:53.978156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:59.363402 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:07:59.363365    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:08:08.262739 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:08.262701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:08.695566 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:08.695537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:09.591607 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:09.591569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:10.292443 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:10.292410    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:11.027420 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:11.027389    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:11.924068 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:11.924033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:13.319546 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:13.319511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:21.281362 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:21.281324    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:08:24.067594 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:24.067558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:24.145056 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:24.145026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:24.226201 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:24.226171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:24.318426 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:24.318337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:24.418605 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:24.418567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:24.693053 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:24.693014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:24.804029 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:24.803998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:25.586442 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:25.586409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:26.488099 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:26.488070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:31.888864 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:31.888834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:31.989244 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:31.989194    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:32.115184 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:32.115146    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"]
Sep 15 12:08:32.115448 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:32.115420    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" containerID="cri-o://282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36" gracePeriod=30
Sep 15 12:08:32.144456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:32.144373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:35.340524 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:35.340486    2564 patch_prober.go:28] interesting pod/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:08:35.340894 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:35.340549    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:08:37.365988 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.365964    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 12:08:37.428992 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.428923    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-socket\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.428992 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.428962    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-certs\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.429213 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.428999    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istiod-ca-cert\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.429213 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429032    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-token\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.429213 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429090    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-podinfo\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.429213 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429133    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-data\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.429463 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429274    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-envoy\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.429463 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429327    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gngqj\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-kube-api-access-gngqj\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.429463 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:08:37.429463 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429369    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-credential-socket\") pod \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\" (UID: \"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e\") "
Sep 15 12:08:37.429463 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429398    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:08:37.429715 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:08:37.429715 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429518    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:08:37.429715 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429649    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:08:37.429925 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429908    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.429994 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429932    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.429994 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429947    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.429994 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429961    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.429994 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.429972    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.431324 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.431296    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:08:37.431477 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.431425    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:08:37.431731 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.431712    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-kube-api-access-gngqj" (OuterVolumeSpecName: "kube-api-access-gngqj") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "kube-api-access-gngqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:08:37.431795 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.431726    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" (UID: "ff45e062-f6da-46a3-a6e6-fff4ddf7f46e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:08:37.531141 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.531111    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.531141 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.531135    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.531320 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.531147    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.531320 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.531159    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gngqj\" (UniqueName: \"kubernetes.io/projected/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e-kube-api-access-gngqj\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:08:37.568538 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.568507    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerID="282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36" exitCode=0
Sep 15 12:08:37.568720 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.568547    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" event={"ID":"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e","Type":"ContainerDied","Data":"282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36"}
Sep 15 12:08:37.568720 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.568566    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"
Sep 15 12:08:37.568720 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.568596    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd" event={"ID":"ff45e062-f6da-46a3-a6e6-fff4ddf7f46e","Type":"ContainerDied","Data":"95d0b2a89f5587a54eb4659da7dc63f7c6257f5dcd443989e9d6d81356aef2a8"}
Sep 15 12:08:37.568720 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.568620    2564 scope.go:117] "RemoveContainer" containerID="282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36"
Sep 15 12:08:37.578397 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.578382    2564 scope.go:117] "RemoveContainer" containerID="3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62"
Sep 15 12:08:37.589693 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.589661    2564 scope.go:117] "RemoveContainer" containerID="282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36"
Sep 15 12:08:37.589973 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:08:37.589954    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36\": container with ID starting with 282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36 not found: ID does not exist" containerID="282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36"
Sep 15 12:08:37.590026 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.589982    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36"} err="failed to get container status \"282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36\": rpc error: code = NotFound desc = could not find container \"282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36\": container with ID starting with 282bbbf0d5b3d6e371bcafd0a1266f83c365cd62d98104c76b142acf7be7ea36 not found: ID does not exist"
Sep 15 12:08:37.590026 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.589999    2564 scope.go:117] "RemoveContainer" containerID="3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62"
Sep 15 12:08:37.590417 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:08:37.590402    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62\": container with ID starting with 3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62 not found: ID does not exist" containerID="3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62"
Sep 15 12:08:37.590479 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.590420    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62"} err="failed to get container status \"3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62\": rpc error: code = NotFound desc = could not find container \"3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62\": container with ID starting with 3bf88b2e520cba3d6b140fbed02aba27e07f1e84abc89937c0f2381f0937fc62 not found: ID does not exist"
Sep 15 12:08:37.594776 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.594753    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"]
Sep 15 12:08:37.599088 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:37.599066    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd"]
Sep 15 12:08:38.756869 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:38.756807    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" path="/var/lib/kubelet/pods/ff45e062-f6da-46a3-a6e6-fff4ddf7f46e/volumes"
Sep 15 12:08:38.969582 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:38.969551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:08:49.422340 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:49.422197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:49.520733 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:49.520696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:51.690471 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:51.690439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:54.667211 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:54.667178    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:08:58.619519 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:08:58.619479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:09:00.041811 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:00.041780    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"]
Sep 15 12:09:00.061777 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:00.061731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:09:07.613214 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:07.613160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:09:09.285667 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:09.285630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:09:15.060562 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.060518    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f" podUID="d570484d-7066-4e4a-8114-d5e05c27d2aa" containerName="main" containerID="cri-o://ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2" gracePeriod=45
Sep 15 12:09:15.312493 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.312436    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:09:15.398867 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.398841    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-dshm\") pod \"d570484d-7066-4e4a-8114-d5e05c27d2aa\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") "
Sep 15 12:09:15.399061 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.398963    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-home\") pod \"d570484d-7066-4e4a-8114-d5e05c27d2aa\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") "
Sep 15 12:09:15.399061 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399001    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vlwk\" (UniqueName: \"kubernetes.io/projected/d570484d-7066-4e4a-8114-d5e05c27d2aa-kube-api-access-4vlwk\") pod \"d570484d-7066-4e4a-8114-d5e05c27d2aa\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") "
Sep 15 12:09:15.399061 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399028    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-model-cache\") pod \"d570484d-7066-4e4a-8114-d5e05c27d2aa\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") "
Sep 15 12:09:15.399257 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399063    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-tmp-dir\") pod \"d570484d-7066-4e4a-8114-d5e05c27d2aa\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") "
Sep 15 12:09:15.399257 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399119    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d570484d-7066-4e4a-8114-d5e05c27d2aa-tls-certs\") pod \"d570484d-7066-4e4a-8114-d5e05c27d2aa\" (UID: \"d570484d-7066-4e4a-8114-d5e05c27d2aa\") "
Sep 15 12:09:15.399385 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399266    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-home" (OuterVolumeSpecName: "home") pod "d570484d-7066-4e4a-8114-d5e05c27d2aa" (UID: "d570484d-7066-4e4a-8114-d5e05c27d2aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:09:15.399385 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399312    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "d570484d-7066-4e4a-8114-d5e05c27d2aa" (UID: "d570484d-7066-4e4a-8114-d5e05c27d2aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:09:15.399495 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399391    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d570484d-7066-4e4a-8114-d5e05c27d2aa" (UID: "d570484d-7066-4e4a-8114-d5e05c27d2aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:09:15.399549 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399513    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-home\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:09:15.399549 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399526    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-model-cache\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:09:15.399549 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.399535    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-tmp-dir\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:09:15.401269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.401198    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d570484d-7066-4e4a-8114-d5e05c27d2aa-kube-api-access-4vlwk" (OuterVolumeSpecName: "kube-api-access-4vlwk") pod "d570484d-7066-4e4a-8114-d5e05c27d2aa" (UID: "d570484d-7066-4e4a-8114-d5e05c27d2aa"). InnerVolumeSpecName "kube-api-access-4vlwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:09:15.401269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.401209    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d570484d-7066-4e4a-8114-d5e05c27d2aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d570484d-7066-4e4a-8114-d5e05c27d2aa" (UID: "d570484d-7066-4e4a-8114-d5e05c27d2aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:09:15.401269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.401212    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-dshm" (OuterVolumeSpecName: "dshm") pod "d570484d-7066-4e4a-8114-d5e05c27d2aa" (UID: "d570484d-7066-4e4a-8114-d5e05c27d2aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:09:15.500619 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.500586    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vlwk\" (UniqueName: \"kubernetes.io/projected/d570484d-7066-4e4a-8114-d5e05c27d2aa-kube-api-access-4vlwk\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:09:15.500619 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.500612    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d570484d-7066-4e4a-8114-d5e05c27d2aa-tls-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:09:15.500619 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.500624    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d570484d-7066-4e4a-8114-d5e05c27d2aa-dshm\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:09:15.776085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.776051    2564 generic.go:356] "Generic (PLEG): container finished" podID="d570484d-7066-4e4a-8114-d5e05c27d2aa" containerID="ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2" exitCode=0
Sep 15 12:09:15.776291 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.776092    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"
Sep 15 12:09:15.776291 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.776139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f" event={"ID":"d570484d-7066-4e4a-8114-d5e05c27d2aa","Type":"ContainerDied","Data":"ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2"}
Sep 15 12:09:15.776291 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.776185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f" event={"ID":"d570484d-7066-4e4a-8114-d5e05c27d2aa","Type":"ContainerDied","Data":"bd03d20032436f46df9cdbdc37f119dbbe54cfb895a85e0315dc0072f9447cae"}
Sep 15 12:09:15.776291 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.776231    2564 scope.go:117] "RemoveContainer" containerID="ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2"
Sep 15 12:09:15.785680 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.785661    2564 scope.go:117] "RemoveContainer" containerID="ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2"
Sep 15 12:09:15.785967 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:09:15.785948    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2\": container with ID starting with ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2 not found: ID does not exist" containerID="ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2"
Sep 15 12:09:15.786015 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.785975    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2"} err="failed to get container status \"ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2\": rpc error: code = NotFound desc = could not find container \"ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2\": container with ID starting with ab3f09e05e67a6a380c75f33bc8f2e394e46e3edf0fc433421ca8f264af1bbf2 not found: ID does not exist"
Sep 15 12:09:15.799560 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.799535    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"]
Sep 15 12:09:15.804069 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:15.804046    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-32bbbb/auth-test-model-32bbbb-kserve-9f7b976b7-tft4f"]
Sep 15 12:09:16.761410 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:16.759386    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d570484d-7066-4e4a-8114-d5e05c27d2aa" path="/var/lib/kubelet/pods/d570484d-7066-4e4a-8114-d5e05c27d2aa/volumes"
Sep 15 12:09:26.897489 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:26.897452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:09:30.082694 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:30.082657    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:09:54.244845 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:09:54.244730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:02.374189 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:02.374155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:05.906947 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:05.906908    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:10:19.793916 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:19.793884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:23.763722 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:23.763689    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:10:26.032680 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:26.032636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:26.132411 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:26.132378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:36.875214 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:36.875173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:10:46.469695 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:46.469655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:47.394985 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:47.394944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:49.757606 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:49.757568    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:10:58.341322 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:10:58.341282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:11:02.265736 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:11:02.265701    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:11:17.605697 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:11:17.605612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:11:21.159570 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:11:21.159533    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:11:22.687054 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:11:22.687006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:11:36.051495 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:11:36.051463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:11:50.566473 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:11:50.566435    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:12:00.162627 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:00.162591    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:12:06.442843 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:06.442800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:07.405436 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:07.405403    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:07.892171 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:07.892126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:08.174945 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:08.174859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:08.786245 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:08.786193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:10.206050 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:10.206018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:10.324251 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:10.324191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:10.423867 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:10.423838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:10.778697 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:10.778665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:12:10.883042 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:10.883005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:10.975008 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:10.974966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:11.183051 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:11.182977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:12.876396 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:12.876364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:13.081463 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:13.081432    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:13.191258 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:13.191198    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:13.363414 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:13.363379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:13.843414 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:13.843368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:13.938428 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:13.938393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:14.501810 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:14.501776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:15.258850 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:15.258819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:24.958635 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:24.958599    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:12:35.702360 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:35.702324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:35.854897 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:35.854858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:36.539475 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:36.539448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:36.794414 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:36.794328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:36.891527 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:36.891491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:37.637513 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:37.637468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:37.772537 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:37.772504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:38.593815 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:38.593773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:39.607290 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:39.607259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:40.091775 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:40.091742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:40.186855 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:40.186824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:40.688280 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:40.688249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:41.600971 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:41.600941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:42.498732 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:42.498695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:43.298601 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:43.298574    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:43.368486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:43.368453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:43.798280 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:43.798245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:43.866773 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:43.866742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:12:47.662586 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:12:47.662509    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:13:06.700430 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:06.700397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:07.702768 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:07.702733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:08.997518 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:08.997480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:09.782583 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:09.782547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:10.200089 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:10.200058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:10.818826 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:10.818794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:22.424806 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:22.424770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:22.524284 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:22.524244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:27.035703 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:27.035671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:30.769780 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:30.769752    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:13:46.769425 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:46.769394    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:13:54.212788 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.212748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:54.554656 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.554578    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"]
Sep 15 12:13:54.555001 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.554988    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy"
Sep 15 12:13:54.555001 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555002    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555015    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d570484d-7066-4e4a-8114-d5e05c27d2aa" containerName="main"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555020    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d570484d-7066-4e4a-8114-d5e05c27d2aa" containerName="main"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555028    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555035    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555046    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555052    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555059    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555064    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555072    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555077    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy"
Sep 15 12:13:54.555083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555089    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555094    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555100    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555105    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555119    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555126    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555140    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="242571be-2a8c-428e-a17f-eb9752043261" containerName="maas-api"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555148    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="242571be-2a8c-428e-a17f-eb9752043261" containerName="maas-api"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555205    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555214    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="242571be-2a8c-428e-a17f-eb9752043261" containerName="maas-api"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555238    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555243    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff45e062-f6da-46a3-a6e6-fff4ddf7f46e" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555248    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555254    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555259    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d570484d-7066-4e4a-8114-d5e05c27d2aa" containerName="main"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555264    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555269    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="45998b63-9a30-447a-83be-e41c1868021c" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555275    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy"
Sep 15 12:13:54.555486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.555282    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy"
Sep 15 12:13:54.558620 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.558602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.565549 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.565530    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-5fd646-openshift-default-dockercfg-8h9vs\""
Sep 15 12:13:54.590261 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.590231    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:54.667654 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.667603    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"]
Sep 15 12:13:54.709532 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9374df1a-679c-46a1-9642-ff6d4359815c-istio-podinfo\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.709532 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-envoy\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.709766 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9374df1a-679c-46a1-9642-ff6d4359815c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.709766 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-socket\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.709766 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-credential-socket\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.709766 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnb7v\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-kube-api-access-fnb7v\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.709986 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-istio-token\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.709986 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-data\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.709986 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.709956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-certs\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.810825 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.810729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-istio-token\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.810825 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.810793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-data\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.810825 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.810826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-certs\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.810869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9374df1a-679c-46a1-9642-ff6d4359815c-istio-podinfo\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.810892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-envoy\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.810931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9374df1a-679c-46a1-9642-ff6d4359815c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.811003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-socket\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.811044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-credential-socket\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.811067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnb7v\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-kube-api-access-fnb7v\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.811327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-certs\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.811363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-data\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811456 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.811434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-credential-socket\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811692 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.811670    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-socket\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.811758 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.811697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9374df1a-679c-46a1-9642-ff6d4359815c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.813305 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.813288    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-envoy\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.813518 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.813503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9374df1a-679c-46a1-9642-ff6d4359815c-istio-podinfo\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.832649 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.832620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-istio-token\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.832859 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.832839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnb7v\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-kube-api-access-fnb7v\") pod \"e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") " pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.869269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.869246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:54.890100 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:54.890076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:55.173957 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:55.173913    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"]
Sep 15 12:13:55.183236 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:13:55.176731    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9374df1a_679c_46a1_9642_ff6d4359815c.slice/crio-e301d5aa509e9d8a7ac9a6e0398cff281fdb82c22946a321ab08a62de2ee8857 WatchSource:0}: Error finding container e301d5aa509e9d8a7ac9a6e0398cff281fdb82c22946a321ab08a62de2ee8857: Status 404 returned error can't find the container with id e301d5aa509e9d8a7ac9a6e0398cff281fdb82c22946a321ab08a62de2ee8857
Sep 15 12:13:55.185303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:55.185266    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:13:55.185396 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:55.185330    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:13:55.185396 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:55.185355    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:13:55.240901 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:55.240876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" event={"ID":"9374df1a-679c-46a1-9642-ff6d4359815c","Type":"ContainerStarted","Data":"e301d5aa509e9d8a7ac9a6e0398cff281fdb82c22946a321ab08a62de2ee8857"}
Sep 15 12:13:56.248192 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:56.248150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" event={"ID":"9374df1a-679c-46a1-9642-ff6d4359815c","Type":"ContainerStarted","Data":"b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79"}
Sep 15 12:13:56.274925 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:56.274873    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" podStartSLOduration=2.274852777 podStartE2EDuration="2.274852777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:13:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:13:56.274100237 +0000 UTC m=+2133.997841925" watchObservedRunningTime="2026-09-15 12:13:56.274852777 +0000 UTC m=+2133.998594469"
Sep 15 12:13:56.869745 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:56.869710    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:56.874848 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:56.874825    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:57.253853 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:57.253823    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:57.254855 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:57.254840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:13:57.646579 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:57.646490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:58.292437 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:58.292410    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:58.389407 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:58.389370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:13:58.808723 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:13:58.808689    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:00.119766 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:00.119735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:00.991490 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:00.991460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:02.017906 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:02.017871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:02.807905 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:02.807870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:02.908698 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:02.908667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:03.437202 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:03.437164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:03.543065 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:03.543029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:03.648626 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:03.648594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:07.376343 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:07.376305    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:14:18.364806 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:18.364775    2564 generic.go:356] "Generic (PLEG): container finished" podID="9374df1a-679c-46a1-9642-ff6d4359815c" containerID="b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79" exitCode=0
Sep 15 12:14:18.365696 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:18.364850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" event={"ID":"9374df1a-679c-46a1-9642-ff6d4359815c","Type":"ContainerDied","Data":"b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79"}
Sep 15 12:14:18.365696 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:18.365341    2564 scope.go:117] "RemoveContainer" containerID="b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79"
Sep 15 12:14:18.366469 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:18.366441    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:14:18.366543 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:18.366506    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:14:18.366543 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:18.366538    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 12:14:19.373098 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:19.373065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" event={"ID":"9374df1a-679c-46a1-9642-ff6d4359815c","Type":"ContainerStarted","Data":"3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19"}
Sep 15 12:14:19.870117 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:19.870079    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:14:19.870370 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:19.870348    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:14:19.870427 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:19.870402    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 12:14:20.870633 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:20.870584    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:14:20.871140 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:20.870657    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 12:14:21.870501 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:21.870462    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:14:21.870808 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:21.870776    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 12:14:22.869845 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:22.869805    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:14:22.870061 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:22.869884    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 12:14:23.870698 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:23.870658    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:14:23.871331 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:23.871292    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 12:14:24.870758 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:24.870706    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 12:14:24.871300 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:24.870782    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 12:14:26.023144 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:26.023106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:14:26.023569 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:26.023542    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:14:26.024355 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:26.024329    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:14:26.828633 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:26.828589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:27.701656 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:27.701629    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:28.377685 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:28.377651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:28.734412 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:28.734377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:29.699595 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:29.699559    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:30.557390 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:30.557356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:31.462480 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:31.462424    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:32.311653 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:32.311614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:33.201930 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:33.201893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:33.940443 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:33.940411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:39.872922 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:39.872892    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:40.550497 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:40.550469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:40.650057 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:40.650029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:40.749551 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:40.749499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:42.185002 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:42.184965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:42.283653 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:42.283601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:43.086913 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:43.086880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:43.895184 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:43.895151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:44.686970 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:44.686933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:45.459636 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:45.459605    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:14:47.833042 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:47.833000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:47.939865 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:47.939834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:48.101427 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:48.101353    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"]
Sep 15 12:14:48.101587 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:48.101564    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy" containerID="cri-o://3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19" gracePeriod=30
Sep 15 12:14:48.128599 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:48.128568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:51.847397 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:51.847355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:52.934483 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:52.934448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:53.350784 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.350756    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:14:53.414202 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414173    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnb7v\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-kube-api-access-fnb7v\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414389 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414245    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-istio-token\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414389 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414298    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9374df1a-679c-46a1-9642-ff6d4359815c-istio-podinfo\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414389 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-certs\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414389 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414336    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-envoy\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414389 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414373    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9374df1a-679c-46a1-9642-ff6d4359815c-istiod-ca-cert\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414658 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414430    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-data\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414658 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414491    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-socket\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414763 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414686    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:14:53.414763 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414743    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-credential-socket\") pod \"9374df1a-679c-46a1-9642-ff6d4359815c\" (UID: \"9374df1a-679c-46a1-9642-ff6d4359815c\") "
Sep 15 12:14:53.414859 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414835    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:14:53.414994 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.414971    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-data" (OuterVolumeSpecName: "istio-data") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:14:53.415132 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.415109    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:14:53.415241 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.415196    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9374df1a-679c-46a1-9642-ff6d4359815c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:14:53.415442 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.415423    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.415442 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.415443    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9374df1a-679c-46a1-9642-ff6d4359815c-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.415569 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.415451    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.415569 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.415460    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.415569 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.415467    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.416575 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.416555    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:14:53.416704 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.416646    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-kube-api-access-fnb7v" (OuterVolumeSpecName: "kube-api-access-fnb7v") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "kube-api-access-fnb7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:14:53.416786 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.416772    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9374df1a-679c-46a1-9642-ff6d4359815c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:14:53.417152 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.417132    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-istio-token" (OuterVolumeSpecName: "istio-token") pod "9374df1a-679c-46a1-9642-ff6d4359815c" (UID: "9374df1a-679c-46a1-9642-ff6d4359815c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:14:53.516513 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.516433    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnb7v\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-kube-api-access-fnb7v\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.516513 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.516457    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9374df1a-679c-46a1-9642-ff6d4359815c-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.516513 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.516467    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9374df1a-679c-46a1-9642-ff6d4359815c-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.516513 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.516475    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9374df1a-679c-46a1-9642-ff6d4359815c-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:14:53.557424 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.557395    2564 generic.go:356] "Generic (PLEG): container finished" podID="9374df1a-679c-46a1-9642-ff6d4359815c" containerID="3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19" exitCode=0
Sep 15 12:14:53.557581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.557451    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"
Sep 15 12:14:53.557581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.557475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" event={"ID":"9374df1a-679c-46a1-9642-ff6d4359815c","Type":"ContainerDied","Data":"3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19"}
Sep 15 12:14:53.557581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.557525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl" event={"ID":"9374df1a-679c-46a1-9642-ff6d4359815c","Type":"ContainerDied","Data":"e301d5aa509e9d8a7ac9a6e0398cff281fdb82c22946a321ab08a62de2ee8857"}
Sep 15 12:14:53.557581 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.557547    2564 scope.go:117] "RemoveContainer" containerID="3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19"
Sep 15 12:14:53.566710 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.566690    2564 scope.go:117] "RemoveContainer" containerID="b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79"
Sep 15 12:14:53.574748 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.574731    2564 scope.go:117] "RemoveContainer" containerID="3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19"
Sep 15 12:14:53.575008 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:14:53.574990    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19\": container with ID starting with 3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19 not found: ID does not exist" containerID="3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19"
Sep 15 12:14:53.575053 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.575016    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19"} err="failed to get container status \"3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19\": rpc error: code = NotFound desc = could not find container \"3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19\": container with ID starting with 3929550e6e0e0354bfa0b4aae2f8781f6fbf298ee2b98c2bb5fff30a72c4fc19 not found: ID does not exist"
Sep 15 12:14:53.575053 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.575032    2564 scope.go:117] "RemoveContainer" containerID="b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79"
Sep 15 12:14:53.575289 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:14:53.575271    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79\": container with ID starting with b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79 not found: ID does not exist" containerID="b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79"
Sep 15 12:14:53.575340 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.575294    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79"} err="failed to get container status \"b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79\": rpc error: code = NotFound desc = could not find container \"b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79\": container with ID starting with b97e184706b150fd42e904c7c464fefba2621683608a45231d20d753d2bade79 not found: ID does not exist"
Sep 15 12:14:53.580979 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.580958    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"]
Sep 15 12:14:53.586407 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:53.586387    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl"]
Sep 15 12:14:54.002351 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:54.002321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:54.756925 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:54.756891    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" path="/var/lib/kubelet/pods/9374df1a-679c-46a1-9642-ff6d4359815c/volumes"
Sep 15 12:14:54.944427 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:54.944396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:14:55.857957 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:14:55.857930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:00.004260 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.004206    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:00.158631 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.158600    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"]
Sep 15 12:15:00.159025 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.159013    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy"
Sep 15 12:15:00.159085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.159027    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9ff3cf-6487-4a58-8b71-9d33237a2351" containerName="istio-proxy"
Sep 15 12:15:00.159085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.159042    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy"
Sep 15 12:15:00.159085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.159047    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy"
Sep 15 12:15:00.159085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.159065    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy"
Sep 15 12:15:00.159085 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.159071    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65c77a3-003e-4e40-998e-aa79fc2d2f39" containerName="istio-proxy"
Sep 15 12:15:00.159264 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.159133    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy"
Sep 15 12:15:00.159264 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.159141    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea1c6eca-19b8-4e31-99df-10104f9be4fc" containerName="istio-proxy"
Sep 15 12:15:00.162233 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.162204    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"
Sep 15 12:15:00.164236 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.164200    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"]
Sep 15 12:15:00.164830 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.164812    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy"
Sep 15 12:15:00.164874 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.164835    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy"
Sep 15 12:15:00.164951 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.164941    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9374df1a-679c-46a1-9642-ff6d4359815c" containerName="istio-proxy"
Sep 15 12:15:00.167785 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.167769    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfdnn\""
Sep 15 12:15:00.168194 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.168170    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"
Sep 15 12:15:00.174379 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.174359    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"
Sep 15 12:15:00.183228 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.183195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"
Sep 15 12:15:00.185763 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.185743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"]
Sep 15 12:15:00.189554 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.189086    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"]
Sep 15 12:15:00.459388 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.459364    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"]
Sep 15 12:15:00.461812 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:15:00.461786    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e8eb3c_7b12_43ad_ac27_697853be7e8f.slice/crio-8400f8db00a2d659a3e1b321efefad17197fbe81efee4240fad1a06dc8f5bbe0 WatchSource:0}: Error finding container 8400f8db00a2d659a3e1b321efefad17197fbe81efee4240fad1a06dc8f5bbe0: Status 404 returned error can't find the container with id 8400f8db00a2d659a3e1b321efefad17197fbe81efee4240fad1a06dc8f5bbe0
Sep 15 12:15:00.467925 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.467882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"]
Sep 15 12:15:00.470334 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:15:00.470309    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef7146b_7888_4e91_b13d_d311f79d8001.slice/crio-597312e93e08bd53709e10f64555e8d5b6e4fd87ad7f0155457e2fa8f0b97d8a WatchSource:0}: Error finding container 597312e93e08bd53709e10f64555e8d5b6e4fd87ad7f0155457e2fa8f0b97d8a: Status 404 returned error can't find the container with id 597312e93e08bd53709e10f64555e8d5b6e4fd87ad7f0155457e2fa8f0b97d8a
Sep 15 12:15:00.595053 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.594959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb" event={"ID":"3ef7146b-7888-4e91-b13d-d311f79d8001","Type":"ContainerStarted","Data":"597312e93e08bd53709e10f64555e8d5b6e4fd87ad7f0155457e2fa8f0b97d8a"}
Sep 15 12:15:00.596210 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:00.596171    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp" event={"ID":"02e8eb3c-7b12-43ad-ac27-697853be7e8f","Type":"ContainerStarted","Data":"8400f8db00a2d659a3e1b321efefad17197fbe81efee4240fad1a06dc8f5bbe0"}
Sep 15 12:15:01.603154 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:01.603113    2564 generic.go:356] "Generic (PLEG): container finished" podID="02e8eb3c-7b12-43ad-ac27-697853be7e8f" containerID="dbe07b337c599056e6fb4e2fc46a8c12eed86bbe21dc5b58be0e946e464eaa07" exitCode=0
Sep 15 12:15:01.603617 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:01.603197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp" event={"ID":"02e8eb3c-7b12-43ad-ac27-697853be7e8f","Type":"ContainerDied","Data":"dbe07b337c599056e6fb4e2fc46a8c12eed86bbe21dc5b58be0e946e464eaa07"}
Sep 15 12:15:01.604918 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:01.604847    2564 generic.go:356] "Generic (PLEG): container finished" podID="3ef7146b-7888-4e91-b13d-d311f79d8001" containerID="c967d03dd984c0e92a51f811cd5132449f568db00ce8c4f93c3d586d188ba03b" exitCode=0
Sep 15 12:15:01.604918 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:01.604888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb" event={"ID":"3ef7146b-7888-4e91-b13d-d311f79d8001","Type":"ContainerDied","Data":"c967d03dd984c0e92a51f811cd5132449f568db00ce8c4f93c3d586d188ba03b"}
Sep 15 12:15:02.048608 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:02.048557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:02.754064 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:02.754035    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"
Sep 15 12:15:02.756938 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:02.756918    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"
Sep 15 12:15:03.616271 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:03.616212    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"
Sep 15 12:15:03.616271 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:03.616244    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb" event={"ID":"3ef7146b-7888-4e91-b13d-d311f79d8001","Type":"ContainerDied","Data":"597312e93e08bd53709e10f64555e8d5b6e4fd87ad7f0155457e2fa8f0b97d8a"}
Sep 15 12:15:03.616527 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:03.616304    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="597312e93e08bd53709e10f64555e8d5b6e4fd87ad7f0155457e2fa8f0b97d8a"
Sep 15 12:15:03.617642 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:03.617624    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"
Sep 15 12:15:03.617769 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:03.617620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp" event={"ID":"02e8eb3c-7b12-43ad-ac27-697853be7e8f","Type":"ContainerDied","Data":"8400f8db00a2d659a3e1b321efefad17197fbe81efee4240fad1a06dc8f5bbe0"}
Sep 15 12:15:03.617769 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:03.617755    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8400f8db00a2d659a3e1b321efefad17197fbe81efee4240fad1a06dc8f5bbe0"
Sep 15 12:15:05.370528 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:05.370496    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:15:07.199961 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:07.199931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:07.761446 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:07.761415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:07.771427 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:07.771398    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"]
Sep 15 12:15:07.777255 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:07.777230    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-7139fb-29824575-sd4sb"]
Sep 15 12:15:07.862328 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:07.862296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:07.962384 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:07.962347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:08.062650 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:08.062556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:08.461689 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:08.461660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:08.557733 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:08.557699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:08.756366 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:08.756289    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ef7146b-7888-4e91-b13d-d311f79d8001" path="/var/lib/kubelet/pods/3ef7146b-7888-4e91-b13d-d311f79d8001/volumes"
Sep 15 12:15:11.255645 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:11.255619    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:11.357008 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:11.356972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:13.523734 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:13.523691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:18.977585 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:18.977551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:15:51.006659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:51.006580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:52.751620 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:52.751580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:59.485866 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:59.485820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:59.593717 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:59.593680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:15:59.802694 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:15:59.802610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:00.553164 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:00.553080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:01.745101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:01.745071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:02.802255 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:02.802212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:03.653409 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:03.653376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:04.639546 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:04.639510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:06.240656 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:06.240620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:11.117005 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:11.116969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:11.130208 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:11.130175    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"]
Sep 15 12:16:11.133642 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:11.133611    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-74aca3-29824575-x6lsp"]
Sep 15 12:16:11.232473 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:11.232434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:11.342398 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:11.342363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:11.523985 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:11.523950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:11.631162 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:11.631110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:11.998246 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:11.998196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:12.204659 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:12.204625    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:12.756747 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:12.756711    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e8eb3c-7b12-43ad-ac27-697853be7e8f" path="/var/lib/kubelet/pods/02e8eb3c-7b12-43ad-ac27-697853be7e8f/volumes"
Sep 15 12:16:13.900836 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:13.900804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:14.827658 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:14.827622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:16:15.509348 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:15.509308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:19.565092 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:19.565056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:19.677742 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:19.677711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:20.072468 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:20.072425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:21.244142 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:21.244108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:22.221833 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:22.221790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:23.106284 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:23.106254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:25.040040 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:25.040008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:25.118282 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:25.118244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:31.140436 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.140402    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"]
Sep 15 12:16:31.140848 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.140587    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw" podUID="dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" containerName="maas-api" containerID="cri-o://399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85" gracePeriod=30
Sep 15 12:16:31.175559 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.175526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:31.283083 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.283053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:31.385546 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.385522    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:16:31.416939 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.416881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:31.502794 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.502764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-maas-api-tls\") pod \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") "
Sep 15 12:16:31.502794 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.502799    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm2mf\" (UniqueName: \"kubernetes.io/projected/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-kube-api-access-lm2mf\") pod \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") "
Sep 15 12:16:31.503047 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.502824    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-metrics-certs\") pod \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") "
Sep 15 12:16:31.503047 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.502915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-openshift-service-ca\") pod \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\" (UID: \"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940\") "
Sep 15 12:16:31.503358 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.503331    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" (UID: "dbb823c0-bd24-47f6-adaa-f9d7f6a1c940"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:16:31.505016 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.504980    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" (UID: "dbb823c0-bd24-47f6-adaa-f9d7f6a1c940"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:16:31.505110 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.505025    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-kube-api-access-lm2mf" (OuterVolumeSpecName: "kube-api-access-lm2mf") pod "dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" (UID: "dbb823c0-bd24-47f6-adaa-f9d7f6a1c940"). InnerVolumeSpecName "kube-api-access-lm2mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:16:31.505110 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.505068    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" (UID: "dbb823c0-bd24-47f6-adaa-f9d7f6a1c940"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:16:31.552046 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.552012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:31.604122 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.604089    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:31.604122 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.604117    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:31.604122 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.604126    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm2mf\" (UniqueName: \"kubernetes.io/projected/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-kube-api-access-lm2mf\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:31.604399 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.604137    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:31.657600 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:31.657560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:32.038866 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.038831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:32.088314 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.088283    2564 generic.go:356] "Generic (PLEG): container finished" podID="dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" containerID="399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85" exitCode=0
Sep 15 12:16:32.088504 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.088336    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"
Sep 15 12:16:32.088504 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.088363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw" event={"ID":"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940","Type":"ContainerDied","Data":"399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85"}
Sep 15 12:16:32.088504 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.088414    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw" event={"ID":"dbb823c0-bd24-47f6-adaa-f9d7f6a1c940","Type":"ContainerDied","Data":"00ae501ab63166a71e595af588a79e902483a0d309922c24dc3df6cb39604268"}
Sep 15 12:16:32.088504 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.088439    2564 scope.go:117] "RemoveContainer" containerID="399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85"
Sep 15 12:16:32.098680 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.098664    2564 scope.go:117] "RemoveContainer" containerID="399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85"
Sep 15 12:16:32.098966 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:16:32.098949    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85\": container with ID starting with 399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85 not found: ID does not exist" containerID="399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85"
Sep 15 12:16:32.099041 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.098975    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85"} err="failed to get container status \"399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85\": rpc error: code = NotFound desc = could not find container \"399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85\": container with ID starting with 399f4bfb1a065d36b0a44630ce3f9177e068d40e824cd23f671f7d4883f3ab85 not found: ID does not exist"
Sep 15 12:16:32.116181 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.116152    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"]
Sep 15 12:16:32.121113 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.121090    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2b3936-d79f9759b-r7xlw"]
Sep 15 12:16:32.189349 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.189318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:32.756197 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:32.756150    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" path="/var/lib/kubelet/pods/dbb823c0-bd24-47f6-adaa-f9d7f6a1c940/volumes"
Sep 15 12:16:33.424137 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:33.424100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:34.323737 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:34.323699    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:16:41.411507 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:41.411464    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:41.520363 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:41.520328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:41.760493 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:41.760459    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"]
Sep 15 12:16:41.760681 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:41.760661    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy" containerID="cri-o://10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa" gracePeriod=30
Sep 15 12:16:41.783031 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:41.783001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:42.449503 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:42.449466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:43.742519 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:43.742473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:45.050488 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:45.050457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:47.012996 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.012971    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:16:47.167819 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.167725    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-data\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.167819 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.167760    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-token\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.167819 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.167776    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97d07825-8754-4dba-b60f-00b20a45ac8e-istiod-ca-cert\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.168111 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.167831    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-credential-socket\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.168111 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.167891    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9nxs\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-kube-api-access-g9nxs\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.168111 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.167932    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-socket\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.168111 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.167997    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-envoy\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.168111 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168069    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-certs\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.168401 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168125    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-podinfo\") pod \"97d07825-8754-4dba-b60f-00b20a45ac8e\" (UID: \"97d07825-8754-4dba-b60f-00b20a45ac8e\") "
Sep 15 12:16:47.168401 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168132    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:16:47.168401 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168184    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:16:47.168401 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168287    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:16:47.168401 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168301    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97d07825-8754-4dba-b60f-00b20a45ac8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:16:47.168671 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168429    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:16:47.168671 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168552    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:47.168671 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168572    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:47.168671 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168585    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97d07825-8754-4dba-b60f-00b20a45ac8e-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:47.168671 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168596    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:47.168671 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.168605    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:47.170186 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.170155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:16:47.170523 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.170495    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-kube-api-access-g9nxs" (OuterVolumeSpecName: "kube-api-access-g9nxs") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "kube-api-access-g9nxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:16:47.170664 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.170647    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:16:47.170708 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.170673    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97d07825-8754-4dba-b60f-00b20a45ac8e" (UID: "97d07825-8754-4dba-b60f-00b20a45ac8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:16:47.173363 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.173335    2564 generic.go:356] "Generic (PLEG): container finished" podID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerID="10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa" exitCode=0
Sep 15 12:16:47.173453 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.173395    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"
Sep 15 12:16:47.173453 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.173408    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" event={"ID":"97d07825-8754-4dba-b60f-00b20a45ac8e","Type":"ContainerDied","Data":"10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa"}
Sep 15 12:16:47.173528 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.173462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2" event={"ID":"97d07825-8754-4dba-b60f-00b20a45ac8e","Type":"ContainerDied","Data":"4e2a4f5beb6e2d78f88cd92960228e2c67347eef5c1fd636a576e93ff04728a6"}
Sep 15 12:16:47.173528 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.173485    2564 scope.go:117] "RemoveContainer" containerID="10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa"
Sep 15 12:16:47.191173 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.191154    2564 scope.go:117] "RemoveContainer" containerID="2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773"
Sep 15 12:16:47.200194 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.200170    2564 scope.go:117] "RemoveContainer" containerID="10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa"
Sep 15 12:16:47.200517 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:16:47.200502    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa\": container with ID starting with 10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa not found: ID does not exist" containerID="10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa"
Sep 15 12:16:47.200572 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.200526    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa"} err="failed to get container status \"10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa\": rpc error: code = NotFound desc = could not find container \"10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa\": container with ID starting with 10bdd29dbe09c9eba6ee39786f0387711c683bcf2819db99e88bfda6a599befa not found: ID does not exist"
Sep 15 12:16:47.200572 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.200542    2564 scope.go:117] "RemoveContainer" containerID="2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773"
Sep 15 12:16:47.200814 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:16:47.200796    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773\": container with ID starting with 2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773 not found: ID does not exist" containerID="2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773"
Sep 15 12:16:47.200869 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.200820    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773"} err="failed to get container status \"2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773\": rpc error: code = NotFound desc = could not find container \"2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773\": container with ID starting with 2de580df636c9a5150f6a5a06e19873032971469fb3c1c957777f16624b6b773 not found: ID does not exist"
Sep 15 12:16:47.210676 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.210650    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"]
Sep 15 12:16:47.213028 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.213006    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2"]
Sep 15 12:16:47.269666 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.269637    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:47.269666 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.269665    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:47.269850 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.269677    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9nxs\" (UniqueName: \"kubernetes.io/projected/97d07825-8754-4dba-b60f-00b20a45ac8e-kube-api-access-g9nxs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:47.269850 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:47.269691    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97d07825-8754-4dba-b60f-00b20a45ac8e-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:48.756714 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:48.756682    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" path="/var/lib/kubelet/pods/97d07825-8754-4dba-b60f-00b20a45ac8e/volumes"
Sep 15 12:16:52.842051 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:52.842020    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"]
Sep 15 12:16:52.842501 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:52.842232    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb" podUID="55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" containerName="maas-api" containerID="cri-o://88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62" gracePeriod=30
Sep 15 12:16:52.864437 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:52.864169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:53.002912 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.002832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:53.092425 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.092365    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:16:53.114383 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.114339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:53.122433 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.122201    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-openshift-service-ca\") pod \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") "
Sep 15 12:16:53.122433 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.122299    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls\") pod \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") "
Sep 15 12:16:53.122433 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.122342    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htjpw\" (UniqueName: \"kubernetes.io/projected/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-kube-api-access-htjpw\") pod \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") "
Sep 15 12:16:53.122735 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.122484    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-metrics-certs\") pod \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\" (UID: \"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad\") "
Sep 15 12:16:53.123077 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.123042    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" (UID: "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:16:53.124985 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.124945    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" (UID: "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:16:53.125181 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.125110    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" (UID: "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:16:53.125304 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.125258    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-kube-api-access-htjpw" (OuterVolumeSpecName: "kube-api-access-htjpw") pod "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" (UID: "55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad"). InnerVolumeSpecName "kube-api-access-htjpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:16:53.207016 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.206983    2564 generic.go:356] "Generic (PLEG): container finished" podID="55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" containerID="88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62" exitCode=0
Sep 15 12:16:53.207188 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.207035    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"
Sep 15 12:16:53.207188 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.207069    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb" event={"ID":"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad","Type":"ContainerDied","Data":"88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62"}
Sep 15 12:16:53.207188 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.207124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb" event={"ID":"55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad","Type":"ContainerDied","Data":"4c627c75009f1bd132f1c4c6b1ebe7823b9055309ec1db968b87d8a115e6e5bb"}
Sep 15 12:16:53.207188 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.207145    2564 scope.go:117] "RemoveContainer" containerID="88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62"
Sep 15 12:16:53.217147 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.217124    2564 scope.go:117] "RemoveContainer" containerID="88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62"
Sep 15 12:16:53.217446 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:16:53.217429    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62\": container with ID starting with 88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62 not found: ID does not exist" containerID="88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62"
Sep 15 12:16:53.217506 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.217455    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62"} err="failed to get container status \"88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62\": rpc error: code = NotFound desc = could not find container \"88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62\": container with ID starting with 88b2c9c535183c31758f37a897bb1913d40c9627c5d5cdcf896ecb6c1afeec62 not found: ID does not exist"
Sep 15 12:16:53.220564 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.220545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:53.224379 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.224359    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:53.224467 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.224381    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:53.224467 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.224395    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:53.224467 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.224408    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htjpw\" (UniqueName: \"kubernetes.io/projected/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad-kube-api-access-htjpw\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:16:53.237273 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.237255    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"]
Sep 15 12:16:53.241014 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.240996    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-32bbbb-785cdc9fcf-nmtgb"]
Sep 15 12:16:53.351166 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.351081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:53.846847 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.846813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:53.950533 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:53.950500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:16:54.756677 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:54.756645    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" path="/var/lib/kubelet/pods/55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad/volumes"
Sep 15 12:16:55.503669 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:16:55.503635    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:17:01.057681 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:01.057649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:17:01.139623 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:01.139586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:17:01.340406 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:01.340321    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"]
Sep 15 12:17:01.340563 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:01.340527    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy" containerID="cri-o://2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e" gracePeriod=30
Sep 15 12:17:01.366694 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:01.366659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:17:05.876499 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:05.876464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:17:06.600163 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.600138    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:17:06.661011 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.660923    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-credential-socket\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661164 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661025    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2pjw\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-kube-api-access-j2pjw\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661164 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661054    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-istio-token\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661164 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661093    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-certs\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661164 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661133    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-socket\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661422 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661182    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:17:06.661422 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661276    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87077052-39a9-4488-9b69-4c3cd36c4240-istiod-ca-cert\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661422 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661327    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-data\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661422 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661360    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87077052-39a9-4488-9b69-4c3cd36c4240-istio-podinfo\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661422 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661384    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-envoy\") pod \"87077052-39a9-4488-9b69-4c3cd36c4240\" (UID: \"87077052-39a9-4488-9b69-4c3cd36c4240\") "
Sep 15 12:17:06.661422 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661414    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:17:06.661802 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:17:06.661802 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661547    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-data" (OuterVolumeSpecName: "istio-data") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:17:06.661802 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661765    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:06.661802 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661785    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-workload-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:06.661802 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661797    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-data\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:06.662064 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661809    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-credential-socket\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:06.662064 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.661829    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87077052-39a9-4488-9b69-4c3cd36c4240-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:17:06.663757 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.663728    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87077052-39a9-4488-9b69-4c3cd36c4240-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:17:06.663757 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.663726    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:17:06.663949 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.663801    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-kube-api-access-j2pjw" (OuterVolumeSpecName: "kube-api-access-j2pjw") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "kube-api-access-j2pjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:17:06.663949 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.663838    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-istio-token" (OuterVolumeSpecName: "istio-token") pod "87077052-39a9-4488-9b69-4c3cd36c4240" (UID: "87077052-39a9-4488-9b69-4c3cd36c4240"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:17:06.763423 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.763393    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87077052-39a9-4488-9b69-4c3cd36c4240-istiod-ca-cert\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:06.763423 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.763422    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87077052-39a9-4488-9b69-4c3cd36c4240-istio-podinfo\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:06.763663 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.763435    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87077052-39a9-4488-9b69-4c3cd36c4240-istio-envoy\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:06.763663 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.763447    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2pjw\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-kube-api-access-j2pjw\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:06.763663 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:06.763459    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87077052-39a9-4488-9b69-4c3cd36c4240-istio-token\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:17:07.287383 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.287348    2564 generic.go:356] "Generic (PLEG): container finished" podID="87077052-39a9-4488-9b69-4c3cd36c4240" containerID="2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e" exitCode=0
Sep 15 12:17:07.287785 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.287401    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"
Sep 15 12:17:07.287785 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.287437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" event={"ID":"87077052-39a9-4488-9b69-4c3cd36c4240","Type":"ContainerDied","Data":"2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e"}
Sep 15 12:17:07.287785 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.287496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x" event={"ID":"87077052-39a9-4488-9b69-4c3cd36c4240","Type":"ContainerDied","Data":"dd7bf770e687bd2a00373093fd438987320ed182b782983d69c75dceef5b31b4"}
Sep 15 12:17:07.287785 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.287526    2564 scope.go:117] "RemoveContainer" containerID="2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e"
Sep 15 12:17:07.296688 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.296667    2564 scope.go:117] "RemoveContainer" containerID="0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc"
Sep 15 12:17:07.304926 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.304909    2564 scope.go:117] "RemoveContainer" containerID="2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e"
Sep 15 12:17:07.305201 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:17:07.305182    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e\": container with ID starting with 2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e not found: ID does not exist" containerID="2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e"
Sep 15 12:17:07.305309 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.305210    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e"} err="failed to get container status \"2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e\": rpc error: code = NotFound desc = could not find container \"2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e\": container with ID starting with 2e3d3463645ef0c7b384f8b1203a948af5a60be90c39d3395ce1767d765c0d6e not found: ID does not exist"
Sep 15 12:17:07.305309 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.305243    2564 scope.go:117] "RemoveContainer" containerID="0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc"
Sep 15 12:17:07.305558 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:17:07.305541    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc\": container with ID starting with 0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc not found: ID does not exist" containerID="0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc"
Sep 15 12:17:07.305604 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.305561    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc"} err="failed to get container status \"0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc\": rpc error: code = NotFound desc = could not find container \"0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc\": container with ID starting with 0848874b899c198aff99d3ea6f2f7fd3c6d9cd7b7a9ad6f5615585b2abedd3dc not found: ID does not exist"
Sep 15 12:17:07.310592 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.310569    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"]
Sep 15 12:17:07.316159 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:07.316136    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x"]
Sep 15 12:17:08.046090 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:08.046056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:17:08.756360 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:08.756326    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" path="/var/lib/kubelet/pods/87077052-39a9-4488-9b69-4c3cd36c4240/volumes"
Sep 15 12:17:34.512936 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:34.512896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:17:34.589493 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:17:34.589454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:18:27.103669 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:18:27.103634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:18:27.411553 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:18:27.411466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:18:28.964103 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:18:28.964065    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:18:55.359367 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:18:55.359265    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:19:03.078595 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:19:03.078563    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:19:11.273849 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:19:11.273815    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:19:23.252516 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:19:23.252484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:19:29.780845 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:19:29.780812    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:19:35.873473 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:19:35.873433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:20:27.638063 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:20:27.637980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:20:30.108212 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:20:30.108160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:21:01.574374 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:21:01.574338    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:21:09.668861 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:21:09.668827    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:21:17.712718 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:21:17.712686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:21:20.267071 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:21:20.267036    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:21:23.170321 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:21:23.170291    2564 scope.go:117] "RemoveContainer" containerID="c967d03dd984c0e92a51f811cd5132449f568db00ce8c4f93c3d586d188ba03b"
Sep 15 12:21:23.180755 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:21:23.180732    2564 scope.go:117] "RemoveContainer" containerID="dbe07b337c599056e6fb4e2fc46a8c12eed86bbe21dc5b58be0e946e464eaa07"
Sep 15 12:21:29.521947 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:21:29.521914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:21:32.384003 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:21:32.383968    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:22:17.618595 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:17.618552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:22:19.610921 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:19.610882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:22:19.955657 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:19.955619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:22:27.366198 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:27.366163    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:22:36.372270 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.372231    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:22:36.924553 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924515    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"]
Sep 15 12:22:36.924926 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924912    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy"
Sep 15 12:22:36.924972 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924928    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy"
Sep 15 12:22:36.924972 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924942    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy"
Sep 15 12:22:36.924972 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924948    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy"
Sep 15 12:22:36.924972 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924954    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy"
Sep 15 12:22:36.924972 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924961    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy"
Sep 15 12:22:36.924972 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924973    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" containerName="maas-api"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924979    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" containerName="maas-api"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924990    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.924995    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925006    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef7146b-7888-4e91-b13d-d311f79d8001" containerName="cleanup"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925010    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef7146b-7888-4e91-b13d-d311f79d8001" containerName="cleanup"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925020    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" containerName="maas-api"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925025    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" containerName="maas-api"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925030    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e8eb3c-7b12-43ad-ac27-697853be7e8f" containerName="cleanup"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925035    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e8eb3c-7b12-43ad-ac27-697853be7e8f" containerName="cleanup"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925095    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925103    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e8eb3c-7b12-43ad-ac27-697853be7e8f" containerName="cleanup"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925111    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb823c0-bd24-47f6-adaa-f9d7f6a1c940" containerName="maas-api"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925116    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="55f9d3dd-7b9d-41e3-b3fc-bda56c2670ad" containerName="maas-api"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925123    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925129    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ef7146b-7888-4e91-b13d-d311f79d8001" containerName="cleanup"
Sep 15 12:22:36.925169 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.925135    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87077052-39a9-4488-9b69-4c3cd36c4240" containerName="istio-proxy"
Sep 15 12:22:36.928410 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.928394    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:36.932092 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.932067    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 12:22:36.932092 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.932091    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 12:22:36.932314 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.932068    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2npzq\""
Sep 15 12:22:36.932361 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.932354    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 12:22:36.935527 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.935473    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:22:36.949746 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:36.949720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"]
Sep 15 12:22:37.051365 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.051325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1599805-6ecd-407a-97ec-3b024cf2ff1c-openshift-service-ca\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.051545 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.051384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-metrics-certs\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.051545 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.051473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npdps\" (UniqueName: \"kubernetes.io/projected/a1599805-6ecd-407a-97ec-3b024cf2ff1c-kube-api-access-npdps\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.051545 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.051527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-maas-api-tls\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.153022 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.152972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-metrics-certs\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.153256 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.153092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npdps\" (UniqueName: \"kubernetes.io/projected/a1599805-6ecd-407a-97ec-3b024cf2ff1c-kube-api-access-npdps\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.153256 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.153144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-maas-api-tls\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.153412 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.153257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1599805-6ecd-407a-97ec-3b024cf2ff1c-openshift-service-ca\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.154047 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.154018    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1599805-6ecd-407a-97ec-3b024cf2ff1c-openshift-service-ca\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.155719 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.155693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-maas-api-tls\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.156086 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.156063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-metrics-certs\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.164067 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.164044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npdps\" (UniqueName: \"kubernetes.io/projected/a1599805-6ecd-407a-97ec-3b024cf2ff1c-kube-api-access-npdps\") pod \"maas-api-6c49d8454d-72xsk\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") " pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.238772 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.238743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:37.531295 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.531269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"]
Sep 15 12:22:37.534208 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:22:37.534178    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1599805_6ecd_407a_97ec_3b024cf2ff1c.slice/crio-cd78de272abfb0461474bfbc76a2353285eee180259870e7f35612ae549be1a9 WatchSource:0}: Error finding container cd78de272abfb0461474bfbc76a2353285eee180259870e7f35612ae549be1a9: Status 404 returned error can't find the container with id cd78de272abfb0461474bfbc76a2353285eee180259870e7f35612ae549be1a9
Sep 15 12:22:37.535622 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.535602    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:22:37.781045 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.781013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:22:37.972819 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:37.972792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk" event={"ID":"a1599805-6ecd-407a-97ec-3b024cf2ff1c","Type":"ContainerStarted","Data":"cd78de272abfb0461474bfbc76a2353285eee180259870e7f35612ae549be1a9"}
Sep 15 12:22:38.979100 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:38.979062    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk" event={"ID":"a1599805-6ecd-407a-97ec-3b024cf2ff1c","Type":"ContainerStarted","Data":"1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789"}
Sep 15 12:22:38.979523 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:38.979145    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:39.017882 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:39.017825    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk" podStartSLOduration=2.580874698 podStartE2EDuration="3.017809917s" totalImagesPullingTime="436.935219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:22:39.016668748 +0000 UTC m=+2656.740410435" watchObservedRunningTime="2026-09-15 12:22:39.017809917 +0000 UTC m=+2656.741551603"
Sep 15 12:22:44.510470 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.510430    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"]
Sep 15 12:22:44.510938 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.510677    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk" podUID="a1599805-6ecd-407a-97ec-3b024cf2ff1c" containerName="maas-api" containerID="cri-o://1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789" gracePeriod=30
Sep 15 12:22:44.516700 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.516677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:44.545015 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.544987    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84696d6768-87ddc"]
Sep 15 12:22:44.545495 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.545477    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d07825-8754-4dba-b60f-00b20a45ac8e" containerName="istio-proxy"
Sep 15 12:22:44.548533 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.548513    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.560528 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.560134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84696d6768-87ddc"]
Sep 15 12:22:44.629364 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.629336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20d1e3b2-4270-454a-922a-dc36b14baffd-maas-api-tls\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.629486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.629406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20d1e3b2-4270-454a-922a-dc36b14baffd-openshift-service-ca\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.629486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.629433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20d1e3b2-4270-454a-922a-dc36b14baffd-metrics-certs\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.629486 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.629470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdmql\" (UniqueName: \"kubernetes.io/projected/20d1e3b2-4270-454a-922a-dc36b14baffd-kube-api-access-cdmql\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.729993 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.729959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20d1e3b2-4270-454a-922a-dc36b14baffd-openshift-service-ca\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.730156 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.730005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20d1e3b2-4270-454a-922a-dc36b14baffd-metrics-certs\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.730156 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.730061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmql\" (UniqueName: \"kubernetes.io/projected/20d1e3b2-4270-454a-922a-dc36b14baffd-kube-api-access-cdmql\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.730156 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.730127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20d1e3b2-4270-454a-922a-dc36b14baffd-maas-api-tls\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.730733 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.730710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20d1e3b2-4270-454a-922a-dc36b14baffd-openshift-service-ca\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.732521 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.732501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20d1e3b2-4270-454a-922a-dc36b14baffd-metrics-certs\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.732651 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.732572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20d1e3b2-4270-454a-922a-dc36b14baffd-maas-api-tls\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.741924 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.741901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdmql\" (UniqueName: \"kubernetes.io/projected/20d1e3b2-4270-454a-922a-dc36b14baffd-kube-api-access-cdmql\") pod \"maas-api-84696d6768-87ddc\" (UID: \"20d1e3b2-4270-454a-922a-dc36b14baffd\") " pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.765828 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.765777    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:44.779887 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.779863    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:22:44.831131 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.831105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-maas-api-tls\") pod \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") "
Sep 15 12:22:44.831303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.831156    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npdps\" (UniqueName: \"kubernetes.io/projected/a1599805-6ecd-407a-97ec-3b024cf2ff1c-kube-api-access-npdps\") pod \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") "
Sep 15 12:22:44.831303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.831239    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1599805-6ecd-407a-97ec-3b024cf2ff1c-openshift-service-ca\") pod \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") "
Sep 15 12:22:44.831303 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.831265    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-metrics-certs\") pod \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\" (UID: \"a1599805-6ecd-407a-97ec-3b024cf2ff1c\") "
Sep 15 12:22:44.831642 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.831613    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1599805-6ecd-407a-97ec-3b024cf2ff1c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1599805-6ecd-407a-97ec-3b024cf2ff1c" (UID: "a1599805-6ecd-407a-97ec-3b024cf2ff1c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:22:44.833474 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.833450    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a1599805-6ecd-407a-97ec-3b024cf2ff1c" (UID: "a1599805-6ecd-407a-97ec-3b024cf2ff1c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:22:44.833761 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.833739    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1599805-6ecd-407a-97ec-3b024cf2ff1c" (UID: "a1599805-6ecd-407a-97ec-3b024cf2ff1c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:22:44.833761 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.833752    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1599805-6ecd-407a-97ec-3b024cf2ff1c-kube-api-access-npdps" (OuterVolumeSpecName: "kube-api-access-npdps") pod "a1599805-6ecd-407a-97ec-3b024cf2ff1c" (UID: "a1599805-6ecd-407a-97ec-3b024cf2ff1c"). InnerVolumeSpecName "kube-api-access-npdps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:22:44.896267 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.896207    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:44.932969 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.932942    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npdps\" (UniqueName: \"kubernetes.io/projected/a1599805-6ecd-407a-97ec-3b024cf2ff1c-kube-api-access-npdps\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:22:44.932969 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.932967    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1599805-6ecd-407a-97ec-3b024cf2ff1c-openshift-service-ca\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:22:44.933149 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.932979    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-metrics-certs\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:22:44.933149 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:44.932988    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1599805-6ecd-407a-97ec-3b024cf2ff1c-maas-api-tls\") on node \"ip-10-0-139-13.ec2.internal\" DevicePath \"\""
Sep 15 12:22:45.012872 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.012834    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1599805-6ecd-407a-97ec-3b024cf2ff1c" containerID="1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789" exitCode=0
Sep 15 12:22:45.013036 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.012881    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"
Sep 15 12:22:45.013036 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.012914    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk" event={"ID":"a1599805-6ecd-407a-97ec-3b024cf2ff1c","Type":"ContainerDied","Data":"1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789"}
Sep 15 12:22:45.013036 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.012967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk" event={"ID":"a1599805-6ecd-407a-97ec-3b024cf2ff1c","Type":"ContainerDied","Data":"cd78de272abfb0461474bfbc76a2353285eee180259870e7f35612ae549be1a9"}
Sep 15 12:22:45.013036 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.012989    2564 scope.go:117] "RemoveContainer" containerID="1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789"
Sep 15 12:22:45.023049 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.023031    2564 scope.go:117] "RemoveContainer" containerID="1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789"
Sep 15 12:22:45.023331 ip-10-0-139-13 kubenswrapper[2564]: E0915 12:22:45.023315    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789\": container with ID starting with 1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789 not found: ID does not exist" containerID="1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789"
Sep 15 12:22:45.023378 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.023339    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789"} err="failed to get container status \"1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789\": rpc error: code = NotFound desc = could not find container \"1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789\": container with ID starting with 1a0ddf04ac1e565f975db8067899531abd0b8cfccb1e4e95576c36175a527789 not found: ID does not exist"
Sep 15 12:22:45.044175 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.044147    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"]
Sep 15 12:22:45.047104 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.047085    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c49d8454d-72xsk"]
Sep 15 12:22:45.172849 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:45.172827    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84696d6768-87ddc"]
Sep 15 12:22:45.174838 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:22:45.174812    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d1e3b2_4270_454a_922a_dc36b14baffd.slice/crio-c0f7e6e230564d3f4b9b141031471247732abe4272f0286bd554d59858c62a83 WatchSource:0}: Error finding container c0f7e6e230564d3f4b9b141031471247732abe4272f0286bd554d59858c62a83: Status 404 returned error can't find the container with id c0f7e6e230564d3f4b9b141031471247732abe4272f0286bd554d59858c62a83
Sep 15 12:22:46.020195 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:46.020155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc" event={"ID":"20d1e3b2-4270-454a-922a-dc36b14baffd","Type":"ContainerStarted","Data":"3d6786f3e4aa2928df2c283a602ae0d03ef7284de032ea812136e64afcd0f351"}
Sep 15 12:22:46.020685 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:46.020211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc" event={"ID":"20d1e3b2-4270-454a-922a-dc36b14baffd","Type":"ContainerStarted","Data":"c0f7e6e230564d3f4b9b141031471247732abe4272f0286bd554d59858c62a83"}
Sep 15 12:22:46.020685 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:46.020312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:46.056147 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:46.056097    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc" podStartSLOduration=1.6906505680000001 podStartE2EDuration="2.056080011s" totalImagesPullingTime="365.429443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:22:46.052965431 +0000 UTC m=+2663.776707118" watchObservedRunningTime="2026-09-15 12:22:46.056080011 +0000 UTC m=+2663.779821697"
Sep 15 12:22:46.756348 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:46.756318    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1599805-6ecd-407a-97ec-3b024cf2ff1c" path="/var/lib/kubelet/pods/a1599805-6ecd-407a-97ec-3b024cf2ff1c/volumes"
Sep 15 12:22:51.106101 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:51.106067    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:22:52.030554 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:52.030528    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84696d6768-87ddc"
Sep 15 12:22:58.424345 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:22:58.424302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:23:00.565847 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:00.565751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:23:06.866355 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:06.866307    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fx8lm"]
Sep 15 12:23:16.369143 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:16.369060    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66bc7bc78c-qf58p_eff48b8e-5759-4724-a4f0-4c04ea994a90/copy-manifests/0.log"
Sep 15 12:23:16.379165 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:16.379131    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66bc7bc78c-qf58p_eff48b8e-5759-4724-a4f0-4c04ea994a90/manager/0.log"
Sep 15 12:23:16.710565 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:16.710536    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-84696d6768-87ddc_20d1e3b2-4270-454a-922a-dc36b14baffd/maas-api/0.log"
Sep 15 12:23:16.955966 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:16.955940    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824560-j79zg_bb64edd5-38d4-44d6-996e-f0fef36061c4/cleanup/0.log"
Sep 15 12:23:18.555358 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:18.555332    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fx8lm_92dc2db0-48d1-4aa1-a905-b8d82fa7c60e/limitador/0.log"
Sep 15 12:23:19.178612 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:19.178583    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nfww7_037fc2c2-c679-4009-9c54-cbda82768919/discovery/0.log"
Sep 15 12:23:19.513949 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:19.513899    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cdq9w_02e96ae3-afac-46e8-960e-fecca7fa8236/istio-proxy/1.log"
Sep 15 12:23:19.874941 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:19.874861    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9c6b8bf6-9cgkq_0456757c-bbf2-4121-833a-8a3e3c44891f/router/0.log"
Sep 15 12:23:20.345129 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:20.345102    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-74ncb_124e6d01-939c-4a74-9719-17444a7a1616/main/0.log"
Sep 15 12:23:20.565944 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:20.565919    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dwpsj_9a637429-1a98-4481-a39e-974ca7da54cd/main/0.log"
Sep 15 12:23:20.681017 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:20.680945    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4d5mj_45d916cb-94b3-4fd8-9c1d-ecad4768a196/main/0.log"
Sep 15 12:23:26.820815 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:26.820779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:23:26.912913 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:26.912878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:23:32.331018 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:32.330987    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xmpv6_7124cf81-448a-4016-887b-1753ecb7c9cc/global-pull-secret-syncer/0.log"
Sep 15 12:23:32.401201 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:32.401171    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log"
Sep 15 12:23:32.547181 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:32.547153    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-13.ec2.internal_7927533a6c5893af59befd4fd5d6b4d6/haproxy/0.log"
Sep 15 12:23:37.881245 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:37.881133    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fx8lm_92dc2db0-48d1-4aa1-a905-b8d82fa7c60e/limitador/0.log"
Sep 15 12:23:38.846697 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:38.846668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:23:38.947499 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:38.947455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7cwd2_a75f6ca7-de6e-4186-8130-1dd5ce82c1df/konnectivity-agent/0.log" limit=1024
Sep 15 12:23:39.365540 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.365504    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_699401a3-de3b-44cf-8230-7520290908c6/alertmanager/0.log"
Sep 15 12:23:39.398758 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.398729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_699401a3-de3b-44cf-8230-7520290908c6/config-reloader/0.log"
Sep 15 12:23:39.434835 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.434765    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_699401a3-de3b-44cf-8230-7520290908c6/kube-rbac-proxy-web/0.log"
Sep 15 12:23:39.463425 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.463400    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_699401a3-de3b-44cf-8230-7520290908c6/kube-rbac-proxy/0.log"
Sep 15 12:23:39.499469 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.499442    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_699401a3-de3b-44cf-8230-7520290908c6/kube-rbac-proxy-metric/0.log"
Sep 15 12:23:39.530149 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.530123    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_699401a3-de3b-44cf-8230-7520290908c6/prom-label-proxy/0.log"
Sep 15 12:23:39.574781 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.574745    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_699401a3-de3b-44cf-8230-7520290908c6/init-config-reloader/0.log"
Sep 15 12:23:39.664636 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.664608    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-p7gkm_f16b7e3e-ea4f-4ace-879a-c043e305f4d1/kube-state-metrics/0.log"
Sep 15 12:23:39.687389 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.687365    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-p7gkm_f16b7e3e-ea4f-4ace-879a-c043e305f4d1/kube-rbac-proxy-main/0.log"
Sep 15 12:23:39.715020 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.714996    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-p7gkm_f16b7e3e-ea4f-4ace-879a-c043e305f4d1/kube-rbac-proxy-self/0.log"
Sep 15 12:23:39.753118 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.753079    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-bfbcd57f6-v787l_664c0e09-c5a4-46b1-887b-226fa7d63366/metrics-server/0.log"
Sep 15 12:23:39.811467 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.811443    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-d46cg_cf64d983-9da3-4030-9cb0-64e8d1f924eb/monitoring-plugin/0.log"
Sep 15 12:23:39.858346 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.858311    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wlft_ba2508c3-4396-4a8b-9144-31cc2ea284e6/node-exporter/0.log"
Sep 15 12:23:39.892907 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.892882    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wlft_ba2508c3-4396-4a8b-9144-31cc2ea284e6/kube-rbac-proxy/0.log"
Sep 15 12:23:39.923457 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:39.923438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wlft_ba2508c3-4396-4a8b-9144-31cc2ea284e6/init-textfile/0.log"
Sep 15 12:23:40.220992 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.220964    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-mmpbc_dbac6a1f-9a04-47cf-bde4-81dfd389d0b0/kube-rbac-proxy-main/0.log"
Sep 15 12:23:40.252122 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.252020    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-mmpbc_dbac6a1f-9a04-47cf-bde4-81dfd389d0b0/kube-rbac-proxy-self/0.log"
Sep 15 12:23:40.281645 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.281621    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-mmpbc_dbac6a1f-9a04-47cf-bde4-81dfd389d0b0/openshift-state-metrics/0.log"
Sep 15 12:23:40.337250 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.337207    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_286b806d-a8e8-4e53-8290-56f2befc5eec/prometheus/0.log"
Sep 15 12:23:40.366383 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.366354    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_286b806d-a8e8-4e53-8290-56f2befc5eec/config-reloader/0.log"
Sep 15 12:23:40.402556 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.402527    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_286b806d-a8e8-4e53-8290-56f2befc5eec/thanos-sidecar/0.log"
Sep 15 12:23:40.433233 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.433201    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_286b806d-a8e8-4e53-8290-56f2befc5eec/kube-rbac-proxy-web/0.log"
Sep 15 12:23:40.460671 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.460648    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_286b806d-a8e8-4e53-8290-56f2befc5eec/kube-rbac-proxy/0.log"
Sep 15 12:23:40.514519 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.514443    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_286b806d-a8e8-4e53-8290-56f2befc5eec/kube-rbac-proxy-thanos/0.log"
Sep 15 12:23:40.549291 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.549267    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_286b806d-a8e8-4e53-8290-56f2befc5eec/init-config-reloader/0.log"
Sep 15 12:23:40.598676 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.598645    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-bmd9g_e36a572b-4cc6-4bd4-85f3-1866e8320bf6/prometheus-operator/0.log"
Sep 15 12:23:40.629188 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.629161    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-bmd9g_e36a572b-4cc6-4bd4-85f3-1866e8320bf6/kube-rbac-proxy/0.log"
Sep 15 12:23:40.667269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.667247    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-sxr8s_3e25cd7c-0eb7-4a3a-beb8-0dce1b27c583/prometheus-operator-admission-webhook/0.log"
Sep 15 12:23:40.707532 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.707491    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-896b796f6-hlbvz_c2498440-6dbb-4196-93f9-bf3afb079681/telemeter-client/0.log"
Sep 15 12:23:40.740343 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.740316    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-896b796f6-hlbvz_c2498440-6dbb-4196-93f9-bf3afb079681/reload/0.log"
Sep 15 12:23:40.771454 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.771371    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-896b796f6-hlbvz_c2498440-6dbb-4196-93f9-bf3afb079681/kube-rbac-proxy/0.log"
Sep 15 12:23:40.807575 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.807550    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4f87946-8rwsh_28c9f38a-73b8-4a68-bf70-ba11a40a38ac/thanos-query/0.log"
Sep 15 12:23:40.836130 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.836102    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4f87946-8rwsh_28c9f38a-73b8-4a68-bf70-ba11a40a38ac/kube-rbac-proxy-web/0.log"
Sep 15 12:23:40.871261 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.871212    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4f87946-8rwsh_28c9f38a-73b8-4a68-bf70-ba11a40a38ac/kube-rbac-proxy/0.log"
Sep 15 12:23:40.901611 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.901587    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4f87946-8rwsh_28c9f38a-73b8-4a68-bf70-ba11a40a38ac/prom-label-proxy/0.log"
Sep 15 12:23:40.929617 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.929594    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4f87946-8rwsh_28c9f38a-73b8-4a68-bf70-ba11a40a38ac/kube-rbac-proxy-rules/0.log"
Sep 15 12:23:40.962888 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:40.962865    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4f87946-8rwsh_28c9f38a-73b8-4a68-bf70-ba11a40a38ac/kube-rbac-proxy-metrics/0.log"
Sep 15 12:23:43.508922 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:43.508885    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-rzfhv_9566d059-9587-4aa4-914a-41bc092ad17f/download-server/0.log"
Sep 15 12:23:44.203387 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.203351    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-gsjjr_09a3958d-a066-4fb6-bba9-c672ffc0e734/volume-data-source-validator/0.log"
Sep 15 12:23:44.765496 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.765459    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"]
Sep 15 12:23:44.766410 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.766053    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1599805-6ecd-407a-97ec-3b024cf2ff1c" containerName="maas-api"
Sep 15 12:23:44.766410 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.766076    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1599805-6ecd-407a-97ec-3b024cf2ff1c" containerName="maas-api"
Sep 15 12:23:44.766410 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.766159    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1599805-6ecd-407a-97ec-3b024cf2ff1c" containerName="maas-api"
Sep 15 12:23:44.769501 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.769482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:44.772261 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.772236    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q4mgh\"/\"openshift-service-ca.crt\""
Sep 15 12:23:44.772372 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.772264    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q4mgh\"/\"default-dockercfg-gg5x2\""
Sep 15 12:23:44.773086 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.773061    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q4mgh\"/\"kube-root-ca.crt\""
Sep 15 12:23:44.780042 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.780023    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"]
Sep 15 12:23:44.918147 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.918112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p55p\" (UniqueName: \"kubernetes.io/projected/6f7e71f2-8c2e-4b8d-966a-64b24a565185-kube-api-access-5p55p\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:44.918361 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.918168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-podres\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:44.918361 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.918240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-lib-modules\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:44.918361 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.918268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-proc\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:44.918361 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:44.918302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-sys\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019015 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.018931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-podres\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019015 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.018975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-lib-modules\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019015 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.019000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-proc\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.019052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-sys\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.019097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-podres\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.019118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-lib-modules\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.019130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-proc\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.019146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f7e71f2-8c2e-4b8d-966a-64b24a565185-sys\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.019269 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.019124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p55p\" (UniqueName: \"kubernetes.io/projected/6f7e71f2-8c2e-4b8d-966a-64b24a565185-kube-api-access-5p55p\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.029387 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.029363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p55p\" (UniqueName: \"kubernetes.io/projected/6f7e71f2-8c2e-4b8d-966a-64b24a565185-kube-api-access-5p55p\") pod \"perf-node-gather-daemonset-kgl44\" (UID: \"6f7e71f2-8c2e-4b8d-966a-64b24a565185\") " pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.080519 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.080485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:45.356900 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.356878    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"]
Sep 15 12:23:45.358717 ip-10-0-139-13 kubenswrapper[2564]: W0915 12:23:45.358690    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f7e71f2_8c2e_4b8d_966a_64b24a565185.slice/crio-cede081fae306c21984b50d394a4acbda60fec2ffbcb77782f3eefc16f27a3f1 WatchSource:0}: Error finding container cede081fae306c21984b50d394a4acbda60fec2ffbcb77782f3eefc16f27a3f1: Status 404 returned error can't find the container with id cede081fae306c21984b50d394a4acbda60fec2ffbcb77782f3eefc16f27a3f1
Sep 15 12:23:45.394501 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.394467    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4rpcz_07e8f995-53c0-429b-be84-96856f74e688/dns/0.log"
Sep 15 12:23:45.419140 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.419112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4rpcz_07e8f995-53c0-429b-be84-96856f74e688/kube-rbac-proxy/0.log"
Sep 15 12:23:45.641811 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:45.641734    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnzpv_0f78406e-e9af-4add-800b-fc0102ec80fb/dns-node-resolver/0.log"
Sep 15 12:23:46.323467 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:46.323436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44" event={"ID":"6f7e71f2-8c2e-4b8d-966a-64b24a565185","Type":"ContainerStarted","Data":"fbbaf920ebcebf340029f2796138e0cba43fd834f86a22ff9b8c2845d1b9431e"}
Sep 15 12:23:46.323927 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:46.323482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44" event={"ID":"6f7e71f2-8c2e-4b8d-966a-64b24a565185","Type":"ContainerStarted","Data":"cede081fae306c21984b50d394a4acbda60fec2ffbcb77782f3eefc16f27a3f1"}
Sep 15 12:23:46.323927 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:46.323513    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:46.445658 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:46.445625    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r85f8_1f9b74e0-7785-465e-ac87-49bc6a9693cd/node-ca/0.log"
Sep 15 12:23:48.247448 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:48.247421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nfww7_037fc2c2-c679-4009-9c54-cbda82768919/discovery/0.log"
Sep 15 12:23:48.369855 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:48.369822    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cdq9w_02e96ae3-afac-46e8-960e-fecca7fa8236/istio-proxy/0.log"
Sep 15 12:23:48.374185 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:48.374165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cdq9w_02e96ae3-afac-46e8-960e-fecca7fa8236/istio-proxy/1.log"
Sep 15 12:23:48.490519 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:48.490491    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9c6b8bf6-9cgkq_0456757c-bbf2-4121-833a-8a3e3c44891f/router/0.log"
Sep 15 12:23:49.537773 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:49.537741    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ln95b_d2a7e706-4087-4419-aad4-d9e6a02ebcfc/serve-healthcheck-canary/0.log"
Sep 15 12:23:50.119774 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:50.119747    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7bgz_429e71b6-6eba-49e5-ae0b-011fad0a1912/kube-rbac-proxy/0.log"
Sep 15 12:23:50.151122 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:50.151096    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7bgz_429e71b6-6eba-49e5-ae0b-011fad0a1912/exporter/0.log"
Sep 15 12:23:50.178065 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:50.178040    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7bgz_429e71b6-6eba-49e5-ae0b-011fad0a1912/extractor/0.log"
Sep 15 12:23:52.338729 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:52.338704    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44"
Sep 15 12:23:52.364146 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:52.364092    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q4mgh/perf-node-gather-daemonset-kgl44" podStartSLOduration=8.36407769 podStartE2EDuration="8.36407769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:23:46.342485505 +0000 UTC m=+2724.066227192" watchObservedRunningTime="2026-09-15 12:23:52.36407769 +0000 UTC m=+2730.087819375"
Sep 15 12:23:53.903637 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:53.903606    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66bc7bc78c-qf58p_eff48b8e-5759-4724-a4f0-4c04ea994a90/manager/0.log"
Sep 15 12:23:53.934763 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:53.934726    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nfww7_037fc2c2-c679-4009-9c54-cbda82768919/discovery/0.log"
Sep 15 12:23:53.979030 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:53.979006    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66bc7bc78c-qf58p_eff48b8e-5759-4724-a4f0-4c04ea994a90/copy-manifests/0.log"
Sep 15 12:23:54.025530 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:54.025419    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cdq9w_02e96ae3-afac-46e8-960e-fecca7fa8236/istio-proxy/0.log"
Sep 15 12:23:54.030175 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:54.030147    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cdq9w_02e96ae3-afac-46e8-960e-fecca7fa8236/istio-proxy/1.log"
Sep 15 12:23:54.117011 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:54.116985    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9c6b8bf6-9cgkq_0456757c-bbf2-4121-833a-8a3e3c44891f/router/0.log"
Sep 15 12:23:55.431205 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:55.431127    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c47996ddf-pw8gz_6071821d-c73c-4a38-8c16-49c5cc143dec/manager/0.log"
Sep 15 12:23:55.469141 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:55.469110    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nj9gw_8efa769a-1450-40e5-ad2c-9c10b93b85a6/openshift-lws-operator/0.log"
Sep 15 12:23:56.669522 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:56.669445    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nfww7_037fc2c2-c679-4009-9c54-cbda82768919/discovery/0.log"
Sep 15 12:23:56.779109 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:56.779081    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cdq9w_02e96ae3-afac-46e8-960e-fecca7fa8236/istio-proxy/0.log"
Sep 15 12:23:56.783843 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:56.783819    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cdq9w_02e96ae3-afac-46e8-960e-fecca7fa8236/istio-proxy/1.log"
Sep 15 12:23:56.867734 ip-10-0-139-13 kubenswrapper[2564]: I0915 12:23:56.867706    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c9c6b8bf6-9cgkq_0456757c-bbf2-4121-833a-8a3e3c44891f/router/0.log"